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SUMMARY 


Objectives 

The  objective  was  to  identify  potential  problem  areas  or  constraints  that  would  affect  the  viability  of  using  a  small 
business  jet,  or  Companion  Trainer  Aircraft  (CTA),  as  an  adjunct  to  maintaining  aircrew  flying  skills  in  the  B-52. 

Backgproimd/lUitionale 

B-52  continuation  training  is  heavily  dependent  on  flying  the  actual  aircraft,  resulting  in  a  very  costly  training 
program.  This  effort  addressed  the  desirability  of  using  small,  low  operating  cost  business  jet  aircraft  in  conjunction 
with  B-52  flying  time  to  maintain  aircrew  skills.  This  effort  was  part  of  a  larger  CTA  test  that  was  terminated  prior  to 
completion. 

Approach 

The  Air  Force  modified  two  T-39  aircraft  to  represent  a  typical  CTA  configuration.  B-52  pilots  and  copilots  were 
dual  qualified  in  these  T-39s.  Crews  then  flew  missions  in  the  T-39  CTAs  in  addition  to  their  normal  B-52  training. 
Pilot  performance  in  T-39s  was  evaluated  by  Military  Airlift  Command  (MAC)  instructor  pilots  and  4950th  Test  Wing 
instructors.  The  First  Combat  Evaluation  Group  (Strategic  Air  Command)  evaluated  performance  in  B-52s.  Further  data 
were  acquired  through  interviews  with  participating  crews  on  other  aspects  of  the  test  program  following  the  termination 
of  the  study. 

Specifies 

Method.  Eight  B-52  pilot/co-pilot  teams  from  the  Second  Bombardment  Wing  at  Barksdale  AFB  were  trained  to 
fly  the  specially  modified  T-39  aircraft.  They  received  initial  T-39A  qualification  training  at  Scott  AFB  from  Military 
Airlift  Command  instructors.  Conversion  training  to  the  modified  T-39Bs  was  provided  at  Barksdale  AFB  by  4950th  Test 
Wing  instructors.  Following  this  phase,  the  pilots  and  copilots  flew  low  altitude  training  missions  with  their  radar 
navigators  and  navigators,  as  well  as  a  4950th  Test  Wing  instructor  pilot,  on  board. 

Results.  During  initial  qualification  training  in  the  T-39,  piloting  performance  in  the  T-39  improved  over  sorties 
but  not  as  rapidly  for  approach  and  landing  as  for  other  mission  phases.  Many  of  the  persistent  problems  seemed  to  be 
due  to  inappropriate  generalization  of  B-52  behaviors  to  the  T-39.  A  similar  pattern  of  behavior  was  reported  by  4950th 
Test  Wing  instructors  during  conversion  training  in  the  T-39B.  Intervals  of  up  to  14  days  between  T-39  sorties  seemed 
to  have  little  effect  on  pilot  performance.  Beyond  that  length  of  time,  T-39  pilot  performance  was  degraded.  Crew 
responses  to  the  program  were  largely  positive.  Major  complaints  concerned  the  differences  in  B-52  and  CTA  navigation 
equipment,  the  lack  of  sensors  to  support  low-level  flight,  and  scheduling  problems. 

Conchiaioiia/Recoiimieiidatioiis 

The  most  persistent  problems  in  second  aircraft  operation  occurred  primarily  during  the  approach  and  landing  phase 
of  the  T-39  mission  and  appeared  to  be  due  to  inappropriate  intrusion  of  B-52  behaviors  in  the  T-39.  In  a  CTA  training 
program,  this  phase  of  the  mission  would  need  special  attention.  The  interval  between  CTA  sorties  also  appears  to  be 
a  critical  factor,  at  least  early  in  the  dual  qualification  process.  The  present  data  suggest  that  this  interval  should  not 
exceed  2  weeks. 
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|J  trained  in  the  CTA  v*ill  transfer  positively  to  the  B-S2,  and  second,  inappropriate  behaviors  will  not  transfer.  A 
theoretical  approach  based  on  transfer-of-learning  considerations  for  a  CTA  revealed  particular  difficulties  in 
specifying  transfer  expectations  for  pilots  and  copilots.  Previous  attempts  to  use  a  second  aircraft  as  a  surrogate  trainer 
have  met  with  mixed  results.  Both  positive  and  negative  effects  on  primary  aircraft  performance  were  observ^ 
However,  these  studies  did  not  utilize  aircraft  modified  to  resemble  the  primary  aircraft  (e.g.,  instrumentationpnor 
attempt  to  fly  missions  in  the  secondary  aircraft  that  were  similar  to  those  in  the  primary  aircraft.^In  response  to  a 
congressional  request  for  proof  of  the  concept  that  a  CTA  could  provide  effective  training,  a  study  was  designed 
involving  operational  SAC  crews.  This  study  employed  a  modified  T-39B  aircraft  to  supplement  B-52  training  for  eight 
aircrews.  The  purpose  of  the  study  was  to  answer  two  major  questions.  First,  what  effect  does  flying  the  secondary 
aircraft  have  on  primary  aircraft  performance?  Second,  can  the  crew  leam  to  safely  operate  the  secondary  aircraft 
while  continuing  to  fly  the  primary  aircraft^^lthough  the  CTA  program  was  cancelled  and  the  test  was  terminated, 
crew  responses  to  the  program  and  problems  encountered  provide  valuable  lessons  for  any  future  CTA  program.  The 
limited  data  also  provide  some  insights  concerning  secondary  aircraft  skill  acquisition. 
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This  research  was  performed  to  satisfy  requirements  of  Air  Force  Human  Resources  Laboratory  Technical 
Planning  Objective  3,  the  thrust  of  which  is  air  combat  tactics  and  training.  The  general  objective  of  this  thrust 
is  to  identify  and  demonstrate  cost-effective  training  strategies  and  training  equipment  capabilities  for  use  in 
developing  and  maintaining  the  combat  effectiveness  of  Air  Force  aircrew  members.  More  sp>ecincally ,  the  research 
was  part  of  that  conducted  under  the  Operational  Unit  Training  Research  subthrust,  which  has  as  its  goal  the 
development  and  evaluation  of  skill  maintenance  and  reacquisition  training  programs.  Work  Unit  112.30252, 
Companion  Trainer  Aircraft  Research  Support,  addressed  a  portion  of  this  subthrust,  namely,  evaluating  the 
training  effectiveness  of  flying  a  secondary  aircraft  to  maintain  B-52  aircrew  mission  readiness.  Dr.  Milton  E.  Wood 
was  the  project  monitor,  and  Dr.  Robert  T.  Nullmeyer  was  the  principal  investigator. 

The  conduct  of  this  research  depended  heavily  on  the  assistance  and  participation  of  a  number  of  personnel 
from  various  organizations.  Lt  Col  Robert  Lancaster,  the  CTA  Test  Director,  and  Capt  Robert  Wenning  of  the  4950 
Test  Wing  (TESTW)  conducted  the  majority  of  the  T-39B  training  and  collected  the  data  on  aircrew  performance 
in  theT-39B.  Capt  Clifden  Banner,  Maj  William  Edwards,  Capt  Stephan  Lee,  and  other  members  of  the  1st  Combat 
Evaluation  Croup  (ICEVG)  provided  crucial  support  in  the  development  of  data  collection  procedures,  design  of 
T-39  training  programs,  and  data  collection  on  the  B-52.  Maj  John  Richard,  the  2nd  Bombardment  Wing  (2BMW) 
Test  Director,  managed  on-site  operations,  and  Capts  George  Cray  and  Steve  Green  of  the  2BMW  conducted 
training  for  radar  navigators  and  navigators  on  the  T-39B.  Particularly  worthy  of  thanks  are  the  2BMW  crews  who 
participated  in  the  test,  for  investing  their  time  and  energy  into  a  sometimes  hectic  program.  Finally,  Ms.  Evelyn 
Beyers  deserves  notice  for  her  assistance  in  the  production  of  technical  materials  and  documentation,  usually  on 
short  notice. 
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COMPANION  TRAINER  AIRCRAFT:  CONCEPT  TEST 


I.  INTRODLCTION 

Continuation  training  for  the  B-52  weapon  system  currently  depends  heavily  on  flight  training  in  the  primary  aircraft 
to  maintain  aircrew  skills.  The  use  of  this  very  costly  training  medium  occurs  at  a  time  when  Strategic  Air  Command 
(SAC)  is  faced  with  increasing  budget  constraints  and  a  need  to  conserve  the  B-52  weapon  system.  SAC  has  pursued 
several  avenues  to  make  the  continuation  training  program  more  efficient,  including  the  procurement  of  a  ground-based 
simulator,  the  B-52  Weapon  System  Trainer  (WST),  to  augment  training.  This  simulator  should  remove  a  significant 
part  of  the  continuation  training  burden  from  the  primary  aircraft.  However,  SAC  training  planners  anticipated  a  limit 
to  the  amount  of  reduction  in  flying  that  could  be  realized  from  ground-based  simulation  because  many  skills,  such  as 
management  of  the  air  environment  and  adaptability  to  flight  conditions,  may  best  be  learned  through  practice  in  the 
actual  flight  environment.  In  addition,  a  rather  sharp  decline  in  average  flight  experience  levels  for  B-52  crews  over 
the  last  decade  (see,  for  example,  Ropelewski,  1980)  was  considered  by  SAC  to  be  a  problem  that  needs  to  be  corrected. 
As  a  result,  flight  training  was  considered  to  be  a  critical  part  of  the  continuation  training  program.  To  minimize 
dependence  on  the  B-52  for  training,  a  “triad”  of  training  devices  was  propiosed,  consisting  of  the  B-52  WST,  reduced 
use  of  the  primary  aircraft,  and  a  low  cost  business  jet  aircraft  augmented  to  provide  training  for  the  radar  navigator, 
navigator,  and  electronic  warfare  ofiflcer  (EWO)  in  addition  to  the  pilot  and  copilot.  Some  training  missions  would  be 
flown  ill  this  Companion  Trainer  Aircraft  (CTA)  to  reduce  the  need  to  fly  the  B-52. 

As  described  by  the  Headquarters  Strategic  Air  Command  (1979),  the  CTA  would  be  a  multi-engine  commercial 
business  iet  aircraft  configured  to  provide  transferable  training  in  the  areas  of  (a)  general  aviation  skills,  (b)  general 
system/operational  skills,  and  (c)  specific  system  skills.  To  accomplish  this,  the  pilot  station  would  be  modified  to 
resemble  the  B-52  cockpit,  and  crew  stations  would  be  added  for  the  radar  navigator,  navigator,  and  EWO.  Cockpit 
instrumentation  would  be  changed  to  reflect  the  B-52,  including  a  B-52-like  flight  director  system,  i.e.,  tactical  air 
navigation/very  high  frequency  omnidirectional  and  radio  range/instrument  landing  system  (TACAN/VOR/ILS)  etc. ,  with 
the  primary  instruments  arranged  in  the  CTA  so  that  the  visual  scan  pattern  would  be  similai-  to  that  in  the  primary  aircraft. 
The  offensive  avionics  station  would  resemble  that  of  the  B-52  in  appearance.  Radar,  heading  system,  and  bombing/ 
navigation  system  (BNS)  operations  would  be  as  similar  as  possible  to  operations  in  the  B-52.  For  the  EWO,  a  closed-loop 
simulation  system  replicating  the  B-52  in  appearance  would  display  a  variety  of  internally  generated  threat  signals  and 
exercise  a  wide  range  of  responses.  Threat  mission  scenarios  would  be  programmed  prior  to  flight,  and  a  recording  of 
threats  and  responses  would  be  made  for  postflight  critiques.  There  was  also  the  possibility  that  the  threat  presentations 
would  be  tied  into  the  navigation  systems,  providing  increased  realism  in  terms  of  geographic  factors  (e.g.,  terrain 
masking  effects)  and  increased  crew  coordination.  No  plans  were  made  to  include  the  B-52  gunner  in  the  original  CTA 
concept. 

The  need  for  a  CTA  program  rests  on  two  critical  assumptions.  The  first  is  that  ground-based  simulation  is  incapable 
of  providing  the  training  expiected  from  the  CTA;  current  B-52  simulators  are  inadequate  and  far  from  state  of  the  art. 
As  an  example,  a  device  presently  used  for  radar  navigator  and  navigator  training  is  actually  a  reconfigured  B-29  simulator 
(Worthey,  1978).  SAC  is  in  the  process  of  acquiring  the  WST,  but  until  the  WST  is  available,  it  would  not  be  feasible 
to  evaluate  the  extent  to  which  ground-based  simulation  could  replace  the  CTA  in  long  term  SAC  training  plans.  The 
effectiveness  of  the  WST  for  providing  skill  maintenance  training  will,  however,  be  evaluated  as  a  separate  effort 
immediately  following  the  availability  of  the  WST  for  training. 

The  second  assumption  is  that  training  in  a  dissimilar  aircraft  would  transfer  positively  in  the  B-52,  reducing  the 
need  to  train  in  the  primary  aircraft  itself.  Warner,  Nullmeyer,  Warner,  and  Killion  (1980)  attempted  to  predict  both 
the  direction  (positive  or  negative)  and  the  magnitude  of  transfer  of  training  from  the  CTA  to  the  B-52,  based  on  the 
seminal  transfer  of  training  work  of  Osgood  (1949).  According  to  Osgood’s  transfer-of-training  surface,  the  major 
determinants  of  predicted  direction  and  magnitude  of  training  transfer  are  the  similarity  between  situations  where  task 
accomplishment  occurs  and  the  similarity  of  the  responses.  Osgood's  surface  would  predict  that  transfer  of  training 
between  the  CTA  and  the  B-52  should  increase  with  increased  similarity  between  the  two  aircraft.  This  transfer  would 
be  positive  when  response  requirements  are  highly  similar,  and  negative  when  the  response  in  one  context  would  lo 
inappropriate  in  the  other. 


For  radar  navigators,  navigators,  and  FWOs,  high  fidelity  simulation  was  expected  for  the  tasks  that  could  lie 
accomplished  in  the  CTA,  and  therefore,  a  high  degree  of  positive  transfer  of  training  to  the  B-52  was  predicted.  For 
pilots,  however,  predicting  the  effects  of  the  CTA  program  was  not  as  straightforward  since  the  reproduction  of  a  B-52 
cockpit  in  a  CTA  is  obviously  impossible,  and  a  high  degree  of  fidelity  between  the  CTA  and  the  B-52  is  impractical. 
Transfer-of-training  predictions  for  pilots  were  based  on  stimulus  and  response  similarities.  For  aircraft-independent 
behaviors  (e.g. ,  instrument  procedural  skills)  where  responses  trained  in  one  aircraft  are  appropriate  in  the  other,  positive 
transfer  of  training  should  result  given  sufficient  stimulus  similarity.  To  the  extent  that  in  similar  situations,  aircraft 
specific  behaviors  learned  in  one  aircraft  were  inappropriate  in  the  other  aircraft  (e.g.,  aircraft  handling),  negative 
transfer  of  training  was  predicted.  This  negative  transfer  would  result  if  a  competing  response  generalized  to  the  wrong 
situation  and  interfered  with  the  correct  behavior.  Because  of  a  number  of  unknowns,  it  was  difficult  to  forecast  the  actual 
impact  of  the  CTA  program  on  pilot  and  copilot  performance  based  on  this  analysis.  This  is  obviously  a  critical  issue 
since  it  concerns  safety  of  flight. 

Actual  data  related  to  the  viability  of  the  CTA  concept  are  mixed.  The  Air  Force  recently  initiated  several  programs 
that  use  surrogate  aircraft  for  pilot  training.  During  the  evaluation  of  a  low-cost  aircraft  augmentation  test  program  (Project 
Constant  Growth),  T-37  and  T-38  sorties  were  used  to  augment  reduced  primary  aircraft  flying  for  mission  ready  pilots. 
T-37  training  missions  were  flown  by  C-141  copilots,  and  T-38  training  missions  were  flown  by  F-4E  and  F-1 1  ID  pilots. 
Kantor,  Noble,  and  Reid  (1977)  studied  the  perceived  value  of  flying  low-cost  surrogate  aircraft  for  maintaining  pilot 
skills  by  surveying  the  attitudes  of  participating  pilots.  The  authors  concluded  that  when  sufficient  primary  aircraft  flight 
time  is  available,  additional  sorties  flown  in  a  surrogate  aircraft  do  not  necessarily  represent  a  worthwhile  training  aid. 
However,  when  primary  aircraft  flying  time  is  substantially  reduced,  an  alternate  aircraft  can  provide  useful  training 
for  maintaining  some  pilot  skills.  A  summary  of  pilot  self-assessments  of  the  impact  of  T-37  or  T-38  training  on  primary 
aircraft  performance  is  given  in  Appendix  A  (Table  A-1).  Although  there  are  noticeable  differences  among  responses 
with  respect  to  primary  aircraft  types,  a  substantial  percentage  of  pilots  in  all  three  groups  reported  beneficial  effects 
on  instrument  flying  in  the  primary  aircraft,  and  a  large  group  of  fighter  pilots  reported  beneficial  effects  on  formation 
flying.  Detrimental  effects  on  operating  procedures  were  reported  by  49%  of  the  pilots  across  all  three  groups  and  more 
than  half  of  the  C-141  copilots  reported  detrimental  effects  on  primary  aircraft  handling  ability.  The  perceived  impact 
on  overall  primary  aircraft  performance  was  evenly  balanced  between  beneficial  and  detrimental  effects  for  all  three 
groups  of  pilots.  This  mixed  pattern  of  results  suggests  that  while  many  pilots  found  some  benefit  from  dissimilar  aircraft 
training  with  respect  to  some  general  flying  skills,  problems  arose  in  specific  areas  for  others,  especially  for  C-141 
copilots. 

Plans  for  Project  Constant  Growth  originally  included  the  evaluation  of  B-52  and  KC-135  copilots  as  well,  but  major 
reductions  in  primary  aircraft  flying  time  for  these  crewmembers  led  to  the  adoption  by  SAC  of  an  operational  low-cost 
aircraft  program  called  the  Accelerated  Copilot  Enrichment  (ACE)  program.  T-37  or  T-38  training  sorties  were  flown 
by  B-52  and  KC-135  copilots  in  addition  to  their  normal  primary  aircraft  training.  Eickhoff  (1977)  reported  the  results 
of  a  survey  regarding  the  impact  of  this  program  from  the  point  of  view  of  the  participants,  their  aircraft  commanders, 
and  supervisory/staff  personnel.  In  general,  respondents  in  ail  three  groups  indicated  improvements  in  copilot  decision¬ 
making  ability,  instrument  procedures,  general  proficiency,  and  confidence.  Problems  were  indicated  concerning  limited 
time  availability  for  copilots,  scheduling  conflicts,  interference  with  primary  duties,  and  landing  in  the  primary  aircraft. 
Assessments  of  the  impact  of  the  ACE  program  on  primary  aircraft  performance  made  both  by  participating  copilots  and 
by  their  aircraft  commanders  are  provided  in  Appendix  A  (Table  A-2).  Responses  from  both  groups  were  very  positive 
with  landing  the  primary  aircraft  emerging  as  the  most  critical  problem  area. 

In  response  to  the  funding  request  for  the  CTA  program,  the  Committee  on  Appropriations  in  the  U.S.  Congress 
House  of  Representatives  requested  a  test  of  the  concept  that,  for  aircrew  skill  maintenance,  flying  a  small  jet  aircraft 
could  be  an  acceptable  substitute  for  flying  in  a  B-52.  The  Air  Force  experience  to  date  provided  mixed  results,  and 
the  efficacy  of  the  CTA  training  concept  could  not  be  predicted  with  a  high  degree  of  confidence.  Therefore,  a  concept 
validation  test  of  the  CTA  was  designed  to  respond  to  the  House  Committee  request. 

One  experimental  approach  originally  considered  to  assess  the  viability  of  CTA  training  was  to  use  a  three  group 
design  consisting  of  one  group  that  continued  with  training  as  usual,  a  second  group  that  had  primary  aircraft  flying 
reduced  to  a  point  where  performance  decrements  could  be  observed,  and  a  third  group  that  was  given  the  same  reduced 
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level  of  primary  aircraft  flying,  augmented  with  CTA  training.  Differences  between  the  first  two  groups  would  reveal 
the  effects  of  reductions  in  primary  aircraft  training,  and  differences  between  the  second  and  third  group  would  reveal 
the  impact  of  CTA  training.  If  successful,  this  design  would  provide  a  compelling  demonstration  of  CTA  training 
effectiveness.  This  approach  was  not  pursued,  however,  for  a  number  of  reasons.  Th-  first  was  that  it  would  involve 
reducing  the  mission  readiness  of  the  SAC  crews  in  the  second  group  (and  potentially  the  third  group  as  welll.  This  was 
unacceptable  to  SAC.  The  second  reason  was  that  the  amount  of  reduction  needed  to  observe  reduced  performance  is 
not  known.  GIANT  SAMPLE  (Charczenki,  1976)  was  conducted  to  determine  this  factor,  but  was  unsuccessful  liecause 
when  flying  time  was  reduced  for  selected  crews,  a  number  of  factors  other  than  amount  of  training  changed  as  well, 
confounding  the  results.  The  third  reason  was  that  it  was  considered  difficult,  if  not  impossible,  to  avoid  similar 
confoundings  in  this  CTA  evaluation  if  the  amount  of  primary  aircraft  training  was  reduced  with  no  replacement. 

The  general  approach  that  was  finally  adopted  was  to  develop  a  trial  program  using  specially  modified  T-39Bs  to 
provide  flying  training  that  augmented  B-52  flying  for  eight  test  crews.  For  this  test,  the  T-39B  cockpit  instrumentation 
was  rearranged  to  duplicate  to  the  greatest  extent  possible  the  scan  patterns  of  primary  instruments  used  in  the  B-52. 
A  radar  altimeter  was  also  added  to  the  existing  instruments.  Figure  1  provides  a  picture  of  the  modified  instrument 
panel.  Radar  navigator  and  navigator  stations  were  also  added  to  the  T-39B  to  provide  capabilities  for  training  radar 
navigation.  Inertial  Navigation  System  (INS)  positioning,  degraded  simulated  bombing,  and  crew  coordination.  The 
equipment  installed  included  an  R-14C  radar,  an  F-16  INS,  a  true  airspeed  indicating  system,  and  simulated  weapon 
control  panels.  The  R-14C  is  a  line-of-sight,  90°  sector  scan,  ground  mapping  radar  currently  used  in  the  F-105.  Figures 
2  and  3  present  pictures  of  the  radar  navigator  and  navigator  stations,  respectively. 


Figure  I .  Pilot/copilot  instrument  panel. 
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Figured.  Navigator  station. 


The  performaiu'i'  ol  these  crew  iiietnhers  following liual  (|iialilieati<)n  in  the  was  l  oinpared  to  their  [)eriortnam-e 

levels  prior  to  dual  (pialifieation.  The  primarv  dependent  measures  were  1st  ('ond)at  Kvaluation  (iroup  (ICKNCd 
profieienev  assessments  in  the  UMOTest  Vi  ing iTKSTW  I  instructor  pilot  (IPl  prolicienev  assessnu'iits  in  the  T-.WH. 

and  suhj<'etive  responses  ol  the  participating  crews  collected  at  the  end  ol  the  test.  Data  collection  lor  the  concept 
vali<lation  test  began  in  May  1981.  In  September  1981.  the  (!T\  program  was  cancelled.  .\t  that  time,  it  was  de<  ided 
to  terminate  the  test  on  .'il  (h  tober  1981.  One  result  of  the  program  (ancellation  was  to  limit  the  resources  available 
to  monitor  crew  performance.  The  original  design  lor  tin-  test  iiu  lmh'd  1(!K\  (I  assessments  ol  performance  in  the  B-.S2 
for  a  sec'ond.  matcherl  group  that  <'ontinued  with  current  li'vels  of  training.  However,  due  to  limited  resources,  this 
monitoring  was  not  accomplished.  The  test  was  also  initially  designed  to  incluile  the  KW  ().  using  a  simulated  electronic 
countermeasures  (KCM)  suite  developed  by  the  .Aeronautical  Systems  Division.  However,  the  test  was  terminated  before 
this  erpiipment  was  available,  so  the  test  program  was  limited  to  pilots.  <-opilots,  radar  navigators,  and  navigators.  A 
separate  evaluation  of  this  K(iM  training  system  is  presenterl  in  Appendix  D  to  this  report. 

Two  major  objectives  w  t're  addressed  by  this  conc*-pt  validation  lest. 

1.  Objective  1:  \Xr  hat  was  the  impar't  of  the  B-.S2/motlified  T-.'f9B  training  program  on  aircrew  perlormance  in  the 
B-.S2y 

The  primary  purpose  of  this  objective  was  originally  to  determine  if  a  CTA  training  program  would  support  B-,S2 
skill  development  and  skill  maintenance  with  reduced  training  in  the  B-52  itself.  However,  at  the  time  when  the  first 
tests  crews  were  undergoing  dual  qualification,  completion  of  modifications  to  the  T-,'i9B  and  final  testing  of  its 
capabilities  were  still  prrK'eeding.  In  the  interest  of  avoiding  detrimental  effects  on  mission  readiness,  B-52  flying  time 
was  not  significantly  reduced.  By  the  time  all  of  the  test  crews  had  received  initial  training  in  the  T-39A  and  both  T-39Bs 
were  available,  the  CTA  program  had  been  cancelled.  Since  the  concept  test  was  then  scheduled  to  be  terminated  on 
31  October  1981,  this  precluded  the  planned  reductions  in  B-.52  activity.  Consequently  the  scope  of  this  objective  was 
reduced  to  the  question  of  whether  T-39B  training  provided  any  beneficial/detrimental  effects  on  B-32  performance.  The 
answer  to  this  question  could  still  be  valuable  information  for  any  planned  CT.A  program,  particularly  if  problem  areas 
were  identified.  Given  the  equipment  on  theT-39B,  the  utility  of  such  information  however,  would  differ  for  pilots/copilots 
and  radar  navigators/navigators. 

Pilots.  Due  to  equipment  limitations  in  the  concept  test  aircraft,  valid  test  results  concerning  probable  CTA  training 
effects  might  be  possible  for  pilots  and  copilots  only.  This  was  not  a  serious  constraint,  since  most  of  the  potential  training 
problems  associated  with  the  full-up  CTA  program  seemed  to  involve  pilot  and  copilot  training  (Warner  et  al.,  1980). 
The  uncertainty  of  CT  A  training  effects  on  pilot  and  copilot  p«‘rformance  arose  because  high  fidelity  simulation  of  a  B-52 
cockpit  would  not  be  possible  in  the  candidate  aircraft  for  the  CTA  program.  Differences  between  the  primary  aircraft 
and  the  CTA  would  most  likely  lead  to  situations  where  the  correct  behavior  in  one  aircraft  would  be  inappmpriate  in 
the  other.  If  these  behaviors  generalized  from  one  aircraft  to  the  other,  negative  transfer  of  training  would  result.  On 
the  other  hand,  if  training  benefits  obtained  from  practicing  general  flying  skills  transfer  from  the  CTA  to  the  B-52  while 
aircraft  specific  behaviors  do  not.  the  CTA  concept  could  represent  a  viable  option  for  B-,52  skill  maintenance  and  crew 
proficiency  training.  Because  of  inherent  differences  between  the  proposed  CTA  and  the  primary  aircraft,  assessing  the 
feasibility  of  the  CT.A  concept  for  pilots  involved  a.ssessing  both  transfer  of  training  of  complementary  behaviors  and 
the  lack  of  transfer  of  competing  behaviors  between  aircraft. 

Radar  Mat  igators  and  Navigators.  A  high  degree  of  fidelity  Ivetween  a  full-up  CTA  and  the  primary  aircraft  would 
b<‘  much  easier  to  ac  hieve  for  radar  nav  igators  and  navigators  than  for  pilots  and  copilots.  Based  on  the  forecasts  made 
by  Warner  et  al.  ( 1980).  CT.A  training  was  expected  to  benefit  B-.52  performance  given  high  fidelity  simulation  of  B-52 
systems  operations.  As  a  consequence,  testing  the  concept  for  these  crew  stations  was  not  considered  to  be  as  critical 
as  was  testing  the  impact  of  dual  qualification  on  pilot  [lerformance. 

The  radar  navigator/tiavigator  station  configuration  in  the  concept  validation  test  aircraft  was  not  representative  of 
either  the  exp«-cted  (!T.A  configuration  or  the  station  in  the  B-.52  itself.  In  particular,  the  radar  installed  in  the  modified 
T-.39Bs  )R-I4(J  radar)  differed  from  B-52  radar  in  several  critical  ways.  R-I4C  radar  is  line  of  sight  while  B-52  radar 
is  north  oriented,  and  unlike  B-.52  radar,  R-14C  radar  has  a  relatively  narrow  sector  scan  and  no  crosshairs.  Some 
differences,  such  as  picture  (piality.  range  marks,  and  antenna  stabilization,  were  partially  correctable  prior  to  the  dual 
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quaiinc-ation  phase  of  this  study.  In  additum.  major  B-.i2  systems,  siieh  as  the  BNS  and  the  SK  AM  eomputer,  were  not 
represented  in  the  modified  T-39B  despite  their  major  impael  on  the  tasks  o(  navigation  and  weapon  delivery  in  the 
primary  aircraft.  Some  training  was  expected  in  dead  reckoning  navigation  ()roeedures,  air  ri-fueling  rendezvous,  and 
possibly  fixed  angle,  target  direct  bombing.  Due  to  the  lack  of  similarity  between  the  radar  navigator  and  navigator  stations 
in  the  modified  T-39Bs  and  either  the  planned  full-up  CTA  or  the  primary  airc'raft,  the  validity  of  the  CTA  concept 
validation  test  for  these  positions  was  questionable.  l,singT-39B  training  effectiveness  estimates  to  predict  CTA  training 
potential  could  be  inappropriate  and  misleading  because  of  differen<-es  Iwtween  the  modified  T-.39B  and  <-xpected  CTA 
designs. 

2.  Objective  2.  What  was  the  nature  of  skill  acquisition  and  what  level  of  proficiency  was  achieved  in  the  concept 
test  aircraft? 

Before  training  could  take  place  in  the  T-39B,  SAC  crews  had  to  be  dual  qualified.  This  process  was  most  critical 
for  pilots,  but  some  familiarization  training  was  also  necessary  for  other  crew  positions.  The  process  of  dual  qualification 
for  the  modified  T-39B  could  provide  insights  into  specific  training  requirements  for  the  dual  qualification  of  experienced 
B-52  crews.  In  addition,  monitoring  of  eventual  proficiency  levels  in  the  concept  test  aircraft  could  indicate  the  types 
of  tasks  that  could  be  trained  in  the  CTA. 

Because  the  pilot  station  for  the  concept  test  aircraft  and  the  T-39  itself  were  fairly  representative  of  a  generic  CTA, 
monitoring  performance  in  the  T-39B  during  the  concept  test  could  provide  valuable  information  to  be  used  to  plan  any 
future  pilot/copilot  dual  qualification  training.  If  a  CTA  type  program  is  adopted  for  B-52  units,  such  information  could 
guide  the  dual  qualification  process  and  identify  particular  problem  areas  or  tasks  that  could  not  be  trained  in  a  CTA. 

II.  METHOD 

Crew  Selection 

Eight  crews  were  selected  from  among  those  available  in  the  SAC  2nd  Bombardment  Wing  (BMW),  Barksdale  AFB, 
to  participate  in  the  study.  The  goal  was  to  select  these  crews  such  that  their  experience  levels  were  generally 
representative  of  the  overall  B-52  crew  force  in  terms  of  pilot  and  copilot  career  tolal/B-52  flying  hours.  Instructor  pilots 
were  eliminated  from  consideration,  as  were  pilots  and  copilots  who  would  be  affected  by  an  upcoming  Permanent  Change 
of  Station  (PCS)  or  Date  of  Separation  (DOS).  Copilots  facing  an  imminent  upgrade  to  aircraft  commander  were  also 
removed  from  consideration.  Following  this  initial  filtering,  16  crews  remained,  8  from  each  of  the  two  B-52  squadnins. 
The  two  squadron  commanders,  a  training  flight  B-52  pilot,  ICEVG  representatives,  and  AFHRI.  personnel  divided 
these  16  crews  into  two  groups,  trying  to  keep  experience  and  proficiency  as  equally  balanced  as  jwissible  between  the 
groups.  Four  crews  from  each  squadron  were  selected  for  the  lest  gniup.  Because  T-.39  training  for  pilots  and  copilots 
would  incur  a  1-year  commitment  on  their  part  and  because  test  crews  would  lie  flying  more  total  hours  than  normal, 
inclusion  in  the  test  group  was  made  voluntary.  Each  crew  was  briefed  separately  about  the  lest  and  its  expected  impact 
on  crew  duties.  Seven  of  the  eight  crews  accepted,  one  declined.  The  declining  crew  was  replaced  by  another  of  the 
16  crews.  Following  crew  selection,  one  of  the  vest  group  pilots  and  one  copilot  had  to  be  replaced  due  to  a  PCS  and 
an  upgrade,  respectively.  This  occurred  before  T-.39  training  had  begun,  and  the  same  crews,  with  a  replacement  pilot 
and  copilot,  continued  in  the  test  group. 

To  illustrate  how  experience  levels  in  the  test  group  compared  to  the  SAC  crew  force.  Figure  4  presents  distribution 
of  B-52  and  career  total  flying  time  for  SAC  pilots  and  Figure  .5  for  copilots.  The  flying  times  for  the  eight  test  crews 
are  represented  in  the  figures  by  the  number  of  X  symbols  appearing  under  the  appropriate  portions  of  the  distribution. 
For  example,  two  of  the  lest  crew  pilots  had  B-,52  flying  time  of  between  ItXX)  and  1200  hours,  so  two  X  symbols  appear 
in  that  column.  Test  crew  pilots  were  in  the  center  of  the  distribution  of  B-.52  and  career  total  flying  time.  Test  crew 
copilots  on  the  other  hand  were  in  the  lower  ranges  of  experience.  These  are  the  type  of  copilots  (i.e..  low  time)  who 
would  be  expected  to  have  the  most  trouble  in  a  CTA  program. 
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Figure  5.  Distributions  of  B>52  and  total  flyin|{  time  for  SAC  copilots. 


Dual  Qualifieation 

F  or  the  purposes  of  the  test,  all  eight  test  crews  had  to  fly  training  sorties  in  a  modified  T-d9B  aircraft.  This  required 
(raining  the  eight  crews  in  the  operation  of  the  T-39B.  The  process  of  dual  qualification  was  most  elaborate  for  pilots 
and  copilots. 

Pilots  and  copilots  received  initial  training  in  the  T-39A.  Ground  school  and  systems  familiarization  took  place 
in  cla.sses  at  Barksdale  AF'B.  Pilot/copilot  teams  were  then  sent  to  Flight  Safety  International  for  simulator  training  and 
to  S-olt  .AF’B  for  initial  checkout  in  the  T-.39A  by  Military  Airlift  Command  (MAC)  IPs.  This  required  a  2-week  temporary 
duly  (TDY I  assignment.  The  pilot/copilot  teams  were  sent  TDY  at  3-week  intervals  with  two  crews  leaving  29  May,  two 
more  on  19  June,  and  then  one  crew  every  .3  weeks  until  all  eight  had  been  trained.  Lpon  return  to  Barksdale  AFB, 
the  pilot  teams  received  conversion  training  and  an  initial  checkout  flight  in  the  modified  T-.39B. 

Following  the  initial  checkout  in  the  T-39B,  the  pilul/copilot  teams  began  flying  low  altitude  routes  with  their  radar 
navigators/navigators  on  board.  The  first  couple  of  flights  were  for  familiarization  and  systems  training  for  the  offensive 
team.  This  training  was  necessary  due  to  the  differences  in  equipment  between  the  B-52  and  the  T-.39B,  particularly 
for  the  radar  navigator.  The  familiarization  training  was  provided  by  2BMW  instructor  personnel  who  had  been  checked 
out  on  the  R-14C  radar  and  the  INS.  Once  an  offensive  team  had  been  checked  out  by  an  instructor,  further  flights  were 
then  employed  for  integral  crew  training  in  a  low  altitude  regime. 


Data  Collection 

Procedures  for  data  collection  were  designed  with  two  purposes  in  mind:  (a)  to  investigate  the  impact  ofT-39  activity 
on  B-52  performance  and  (b)  to  trace  the  acquisition  of  skill  in  the  T-39.  To  accomplish  the  former  goal,  two  types  of 
data  were  gathered.  The  first  type  was  evaluations  conducted  by  ICFVG  personnel  during  routine  training  missions  in 
the  B-52.  The  second  type  of  data  was  comments  by  the  crews  during  interviews  conducted  at  the  end  of  the  lest.  Skill 
acquisition  in  the  T-.39  was  monitored  using  similar  procedures.  Grades  and  comments  from  MAC  instructors  at  Scott 
AFB  were  recorded  to  look  at  initial  training  in  the  T-39A.  4950TESTW  IP  evaluations  were  performed  in  the  T-,39B 
at  Barksdale  AFB  during  a  variety  of  training  missions.  Comments  during  the  final  interviews  were  also  utilized. 

The  ICEVG  and  4950  evaluations  employed  a  data  format  developed  specifically  for  this  lest.  Initially,  B-52 
performance  measures  were  selected  by  iCEVG  and  AFHRL  based  on  modified  criteria  from  SAC  Regulation  (SACRI 
60-4.  Wherever  possible,  behavior  was  to  be  judged  using  an  objective  scale  (e.g.,  feet,  degrees,  or  seconds).  Of 
particular  interest  were  deviations  from  a  planned  value  (e.g.,  takeoff  airspeed).  These  will  be  referred  to  as  tolerance 
deviations.  Other  areas  were  judged  using  a  four-point  scale  with  the  following  categories:  excellent,  satisfactory, 
marginal,  and  unsatisfactory.  These  categories  were  selected  due  to  their  familiarity  to  the  evaluators,  as  they  are  defined 
in  SACR  60-4.  For  pilots,  the  areas  graded  closely  followed  SACR  60-4  events.  For  radar  navigators  and  navigators, 
SACR  60-4  provided  a  framework  for  data  collection,  but  several  areas  were  broken  out  into  finer  detail.  F'or  all  crew 
positions,  crew  coordination  and  communication  were  included  for  numerous  portions  of  the  mission.  The  forms 
developed  are  displayed  in  Appendix  B. 

Similar  forms  were  prepared  for  use  by  49,50  IPs  on  the  T-,39.  These  were  identical  to  the  B-.52  forms  wherever 
possible,  but  were  changed  in  appropriate  areas  to  reflect  differences  in  equipment  and/or  operation.  These  forms  are 
displayed  in  Appendix  C.  To  perform  the  ratings,  ICEVG  and  4950  personnel  would  either  circle  the  appropriate  symbol 
(e.g. ,  excellent  (E),  satisfactory  (S),  marginal  ( M ),  or  unsatisfactory  (L ))  or  mark  the  appropriate  location  on  a  scale. 

Data  were  collected  by  ICEVf;  personnel  on  routine  training  flights  in  the  B-52  flown  by  the  test  crews.  For  the 
purposes  of  the  test,  ICEVG  instructors  acted  solely  as  observers,  abn)galing  their  normal  responsibility  to  report 
unsatisfactory  performance.  If  safety  of  flight  problems  aro8«-,  the  ICFiVfJ  instructor  was  allowed  to  intervene  and  reported 
the  incident  to  the  2BMW  test  director,  who  then  arranged  for  appropriate  corrective  training.  1(.F.V(»  [H-rsonnel  did 
not  provide  feedback  to  the  crews  on  such  data  collection  sorties,  so  as  to  have  minimal  influence  on  the  crew  s  Iwhavior. 
The  4950  IP  evaluations  took  place  on  sorties  following  the  initial  “conversion  ridels  I  in  the  T-.I9B  and  the  familiarization 
sortiesfs)  for  the  radar  navigator/navigator.  These  initial  sfjrties  were  viewed  as  primarily  instnn  tional,  so  further  duties 
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for  the  IP  were  avoided.  Data  from  these  initial  sorties  were  collec  ted  from  the  c  omments  made-  hy  the  IP  in  the  flight 
records. 

The  interview  data  was  collected  during  the  week  immediately  following  the  termination  of  the  test.  The  interv  iews 
were  conducted  at  Barksdale  AFB,  at  times  which  were  convenient  for  the  various  crews.  Kaeh  crew  in  the  test  group 
was  interviewed  separately.  Due  to  TDY  or  other  duties,  one  pilot  and  two  radar  navigators  were  not  able*  to  participate. 
The  interviews  were  taped  for  later  transcription.  During  the  interviews,  a  series  of  questions  were  direetc*d  to  the  crew 
members.  The  following  topics  were  covered: 

1 .  Overall  impressions  of  the  program. 

2.  Changes  which  they  would  have  made  in  the  program. 

3.  What,  if  any,  training  occurred. 

4.  Specific  problems  in  the  B-52  or  the  T-39. 

5.  Probable  success  ofaCTA  program,  given  better  equipment. 

6.  Additional  equipment  that  would  be  necessary  in  a  CTA. 

7.  What  could/could  not  be  trained  in  a  CTA. 

8.  Scheduling,  for  the  test  program  and  for  a  CTA. 

Data  concerning  performance  during  initial  training  in  the  T-39  at  Scott  AFB  came  from  the  training  folders  of  the 
pilot/copilot  teams.  The  data  employed  included  ratings  on  .MAC  Form  21-X  and  comments  from  MAC  Form  21-1 .  These 
ratings  and  comments  were  recorded  for  each  of  the  five  training  flights  in  the  T-39  at  Scott  AFB.  The  ratings  used  by 
the  Scott  IPs  were  P  (proficient)  and  T  (training  required). 


Data  Analyaia 

Data  from  the  ICEVG  and  4950  IP  rating  forms  were  tabulated  as  to  the  frequency  of  each  category  of  rating  or 
tolerance  deviation.  For  ratings  on  the  four-point  scale,  excellent  (E),  satisfactory  (S),  marginal  (M),  and  unsatisfactory 
(U),  data  were  tabulated  in  terms  of  the  number  of  E,  S,  and  M/U  ratings.  The  M  and  U  ratings  were  combined  due 
to  their  relative  infrequency. 

For  quantitative  scales  (e.g. ,  airspeed),  data  were  tabulated  in  terms  of  the  number  of  deviations  from  the 
recommended  value.  To  clarify  this,  consider  the  following  scale  for  deviations  in  airspeed  (in  KIAS)  during  climb/ 
instrument  departure; 


-15  -10  -5  0  +5  -1-10  +15 


The  zero  point  refers  to  the  recommended  airspeed.  The  negative  values  indicate  airspeeds  below  the  recommended 
value,  the  positive  ones  above  it.  The  particular  values  for  each  scale  were  based  on  SACK  60-4  standards  and/or  ICEVG 
recommendations.  To  tabulate  the  data,  the  sign  (positive  or  negative)  was  ignored.  Fur  analysis  purposes,  the  data  were 
categorized  in  four  bins: 

(1)  Less  than  one  deviation  away  from  the  required  value  (in  the  above  example,  between  — 4and  +4) 

(2)  From  one  up  to  but  not  including  two  deviations  (from  5  to  9  in  either  the  positive  or  negative  range) 

(3)  From  two  up  to  but  not  including  three  deviations  (from  10  to  14) 

(4)  Three  or  more  deviations  (15  or  more).  In  reporting  these  data,  the  following  symbols  will  be  used  to  refer  to 
the  four  groups,  respectively:  (1)  <  1;  (2)  ^  1;  (.3)  S  2;  and  (4)  ^  3.  Once  the  data  were  tabulated,  it  was  possible 
to  compute  the  relative  frequencies  of  the  various  bins. 
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Ill  some  cases,  a  traiisforiiialioii  of  the  data  was  used  for  analysis  imrposes  so  as  to  avoid  the  prolih'iii  of  uiie(|ual 
weighting  of  the  overall  distributions  by  differences  in  the  nuinber  of  observations  across  individuals  and/or  conditions. 
For  the  rating  data,  a  mean  rating  was  calculated  by  assigning  the  values  d,  2,  aiul  1  to  the  ratings  K,  S,  and  M/L, 
respectively.  These  values  were  multiplied  by  the  respective  proportion  of  such  ratings  and  then  summed  to  arrive  at 
a  mean  rating.  The  tolerance  deviations  were  handled  in  a  similar  fashion,  with  the  values  4,  d,  2,  and  1  assigned  to 
the  deviations  of  <  1 ,  &  1 ,  ^2,  and  ^d,  respectively. 

Comments  were  solicited  along  with  ratings.  Generally,  the  comments  clarified  the  reasons  for  less  than  satisfactory 
performance.  Both  comments  and  interview  data  will  In-  discussed  when  they  help  to  clarify  the  rating  data  or  supplement 
it. 


Limitationa 

Before  discussing  the  results,  several  critical  factors  which  limit  the  conclusions  that  can  be  drawn  must  be 
mentioned.  .Most  important  was  the  termination  of  the  test  on  31  October  1981.  Since  the  first  integral  crew  mission 
on  the  T-39B  was  flown  on  16  September,  there  was  very  little  lime  to  fly  training  sorties  in  the  T-39B.  This  limited 
both  the  degree  of  skill  acquired  in  the  T-.39  (and  the  attendant  data  base)  as  well  as  the  opportunity  for  changes  in 
performance  in  the  B-52. 

The  time  factor  also  affected  the  data  collection  process,  particularly  the  ICEVG  evaluations.  Because  of  other 
duties,  evaluators  were  not  always  available  to  fly  data  collection  sorties.  When  it  was  determined  that  the  CTA  program 
and  test  were  to  be  terminated,  a  decision  was  made  to  concentrate  on  evaluations  of  the  lest  crews.  This  meant  that 
no  comparison  data  from  the  monitored  group  would  be  available,  but  at  least  wilhin-group  comparisons  could  be  made. 
However,  such  comparisons  confound  T-39B  training  with  lime  and  so  must  lx-  viewed  with  caution.  Additionally,  radar 
navigator/navigator  performance  was  not  assessed  on  the  T-39B.  This  was  due  to  the  short  time  available  for  integral 
crew  missions  and  the  lack  of  availability  of  ICEVG  personnel. 

These  factors  affect  the  utility  and  generalizabilily  of  the  data.  However,  there  are  interesting  trends  in  the  data 
which  are  worthy  of  note.  With  these  cautions  in  mind,  the  results  can  now  be  discussed. 


111.  RESULTS 


The  results  of  the  ICEVG,  4950  IP,  and  Scott  IP  evaluations  can  be  discussed  in  terms  of  the  two  primary  issues 
addressed  in  this  test.  First,  what  impact,  if  any,  did  training  on  the  T-.39  have  on  performance  in  the  B-52?  Second, 
what  did  the  skill  acquisition  process  look  like  and  what  level  of  skill  was  attained  in  the  T-.39?  These  two  issues  will 
be  discussed  separately. 


Impact  on  B-52  Performance 

The  primary  source  of  data  on  B-,52  performance  was  the  ICEVG  evaluations.  A  total  of  1 1  evaluation  flights  were 
accomplished  with  various  crews  in  the  test  group  before  their  pilots/copilots  were  trained  in  the  T-,39.  Following  T-.39A 
training  for  the  pilot/copilot  teams,  nine  evaluations  were  performed  prior  to  program  termination.  Unfortunately,  these 
evaluations  were  not  evenly  distributed  across  crews  or  conditions.  Additionally,  when  the  data  were  inspected,  evidence 
for  an  evaluator  effect  was  noted.  This  limited  any  c-omparisons  which  could  be  made  to  those  flights  which  involved 
the  same  evaluator  as  well  as  the  same  crew.  This  severely  limited  the  number  of  possible  comparisons.  Concerning 
the  effects  of  T-.39  training,  data  on  performance  both  before  and  after  such  training  were  available  for  only  two  pilots 
and  two  copilots.  This  obviously  limits  the  generalizability  of  such  data.  The  data  on  radar  navigators  and  navigators 
were  even  more  problematic.  Essentially,  there  was  only  one  case  where  the  same  evaluator  observed  a  crew  both  before 
and  after  the  crew’s  pilots  received  T-.39  training.  Given  this  limitation,  the  performance  data  for  radar  navigators  and 
navigators  will  not  be  discussed  any  further. 
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Table  1  presents  the  mean  rating  for  each  B-S2  evaluation  flight  for  each  pilot  and  copilot  both  before  and  after 
T-39A  training.  Also  included  in  the  table  is  a  notation  concerning  which  of  three  evaluators  made  the  ratings.  Because 
there  were  so  few  cases  where  the  same  evaluator  flew  with  a  particular  crew  both  before  and  after  T-39A  training,  no 
statistical  tests  were  performed  on  the  data.  However,  of  the  seven  possible  comparisons,  six  showed  an  increase  in  the 
average  rating  and  only  one  showed  a  decrease.  The  magnitude  of  the  decrease  was  only  .02.  Averaged  across  pilots 
and  copilots,  the  mean  rating  before  T-.39  training  was  1.97,  after  T-.39  training  it  was  2. .3.3.  Although  these  data  must 
be  viewed  with  caution,  they  do  suggest  that  there  was  no  clear  negative  impact  of  T-39  training  during  the  period  of 
this  test. 


Table  1 .  Average  Rating  for  each  B-52  Evaluation  Flight 
before  and  aAer  T-39  Training  for  each  Pilot  and  Copilot 


Crew 

Fb^t  No. 

Before  T-39  Traininc 

After  T-39  Trainiiuc 

PUol 

Copilot 

Evaluator 

PUol 

Copilot 

Evaluator 

1 

1 

1.90 

1.77 

A 

2.47 

2.20 

A 

2 

1.90 

1.80 

A 

2.79 

2.65 

C 

3 

2.95 

2.79 

B 

2 

1 

2.18 

2.07 

B 

2.68 

— 

B 

2 

2.21 

2.04 

A 

2.96 

2.92 

C 

3 

2.19 

2.12 

A 

3 

1 

2.04 

1.96 

A 

2.a3 

2.89 

B 

2 

2.08 

2.03 

A 

4 

1 

2.12 

1.95 

A 

2.. 38 

2.27 

B 

5 

1 

2.64 

2.57 

B 

2 

2.63 

2.57 

B 

3 

2.82 

2.80 

C 

6 

1 

2.57 

2.31 

A 

7 

1 

1.97 

1.97 

A 

One  question  which  could  be  asked  atiout  these  data  concerns  its  sensitivity.  If  the  measures  are  insensitive  to 
critical  variables,  then  any  inferences  which  could  be  drawn  are  limited.  As  a  simple  test  of  sensitivity,  comparisons 
were  made  between  the  pilot  and  copilot  of  each  crew.  If  the  measures  are  valid,  they  should  reflect  the  difference  in 
experience  levels  between  pilots  and  copilots.  Comparing  the  average  rating  for  each  pilot  to  that  for  the  corresponding 
copilot,  six  pilots  show  superior  ratings,  and  there  is  one  tie.  This  is  significant  by  a  Wilcoxon  test  (£<  .02).  The  average 
rating  for  pilots  was  2.40  and  for  copilots  was  2.30. 

One  concern  in  this  test  was  that  the  results  could  be  tainted  by  adaptation  to  the  test  environment.  That  is,  the 
B-52  performance  data  might  be  affected  simply  by  the  crew  becoming  used  to  the  presence  of  an  evaluator.  One  way 
to  look  at  this  possibility  would  be  to  compare  performance  between  the  evaluation  flights  prior  to  the  introduction  of 
T-39  training.  Although  the  data  available  were  meager,  they  did  not  suggest  that  any  such  adaptation  was  taking  place. 
Considering  ratings  for  each  of  the  four  areas  (procedures,  technique,  crew  coordination,  communication)  separately, 
there  were  24  such  comparisons  possible.  Of  these,  12  showed  improvement  across  flights,  11  showed  a  decrement, 
and  one  was  a  tie.  Clearly,  no  significant  pattern  emerged. 


Sit <11  Acquisitioii  in  the  T-39 

The  data  on  skill  acquisition  in  the  T-39  comes  from  two  sources,  initial  training  in  the  T-39A  and  crew  training 
in  the  T-39B.  These  data  are  of  interest  for  two  reasons.  First,  they  can  provide  a  general  picture  of  the  process  of  skill 
acquisition  in  a  CTA  type  aircraft.  Second,  information  on  particular  errors  can  provide  an  indication  of  negative  transfer 
from  the  B-52  to  the  T-39.  That  is,  what  habits  developed  in  the  B-52  seem  to  carry  over  into  the  T-39? 


Dual  qualification  for  pilot/copilot  teams  began  with  an  initial  checkout  in  the  T-39A  at  Scott  AFB.  Kach  of  these 
teams  received  five  simulator  training  sessions  and  five  actual  flights  in  the  aircraft.  During  these  training  flights,  the 
pilots/copilots  were  graded  by  MAC  IPs  using  MAC  Form  21-X.  The  grades  used  were  P  (proficient)  or  T  (training 
required).  The  pilots/copilots  were  graded  in  a  variety  of  areas.  Table  2  lists  the  number  of  pilots  and  copilots  receiving 
T  grades  in  each  of  the  applicable  areas  for  each  of  the  first  four  flights  in  the  T-39A  (no  T  grades  were  given  on  the 
fifth  flight).  The  total  number  of  individuals  graded  for  each  area  on  each  flight  is  presented  to  the  right  of  the  slash. 
Two  patterns  in  the  data  are  worthy  of  note.  First,  the  number  of  T  ratings  shows  a  general  reduction  from  the  first  to 
the  fourth  flight.  Second,  there  is  a  definite  trend  toward  a  concentration  of  errors  in  the  landing  portion  of  the  mission 
in  moving  from  the  first  to  the  fourth  flight.  This  second  trend  reflects  the  fact  that  landing  is  the  most  difficult  portion 
of  the  flight.  Additionally,  landing  is  the  area  where  differences  in  handling  between  the  B-52  and  the  T-39  are  most 
pronounced  and  was  expected  to  be  the  most  troublesome  (Warner et  al. ,  1980). 

Table  2.  Number  of  Pilots  and  Copilots  Receiving  a  T  Rating  out  of  the  Number 
Graded  for  each  of  the  First  Four  Training  Flights  at  Scott  AFB 


Flinht  No. 


Gradiiig  Area 

1 

2 

3 

4 

Before  Takeoff 

a.  Crew  Briefing 

2/12 

0/12 

0/12 

0/12 

Takeoff  (Rofling/Static) 

4/12 

2/12 

0/14 

0/12 

Airwork 

a.  Runaway  Trim 

1/11 

0/2 

0/4 

0/2 

Instrument  Approaches 

a.  Instrument  Departure  and  Climb 

1/14 

0/16 

0/15 

0/15 

b.  Descent/Approach  Brief 

3/14 

0/15 

0/16 

0/15 

c.  Holding 

0/1 

1/14 

0/8 

0/3 

d.  Procedure  Turn 

0/9 

1/12 

0/4 

0/6 

e.  PAR 

1/12 

1/5 

0/9 

0/6 

f.  LOC  BC 

0/4 

1/8 

0/3 

1/7 

g.  VOR 

2/8 

1/11 

0/4 

0/6 

h.  Missed  Approach 

0/1 

2/8 

1/11 

0/8 

i.  Simulated  Single  Engine  Missed  Approach 

6/12 

1/12 

1/10 

j.  No-Flap  Approach 

0/4 

1/6 

0/11 

0/11 

VFR  Approaches 

a.  Circling  Approach 

3/9 

2/14 

1/15 

0/14 

b.  VFR  Pattern 

6/12 

4/12 

1/16 

1/16 

Landings 

a.  Simulated  Single  Engine 

0/1 

2/14 

0/14 

1/15 

b.  Full-Flap  Landing 

8/15 

6/16 

0/16 

2/16 

c.  No  Flap 

4/9 

1/11 

0/16 

0/14 

d.  Partial  Flap 

1/2 

0/11 

0/15 

0/13 

e.  Emergency  Brakes 

0/1 

1/7 

0/9 

f.  Crosswind  Landing  Procedure 

1/6 

2/12 

0/10 

2/10 

g.  Wet/Slippery  Runway  (RW)/Procedure 

3/5 

4/8 

3/12 

1/15 

Taxi,  Braking,  Steering 

1/14 

0/13 

0/16 

0/14 

CheckUstUse 

10/14 

10/16 

1/15 

1/14 

Crew  Coordination 

2/12 

1/13 

0/14 

0/13 
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()(  {>arfi<'iiljr  iiilcrcsl  were  arcii-i  wiuTv  [KTsisl»-iil  prohlcnis  tH't  iirrvd.  Tahlc  .'J  lists  the  iiimil«'r  <il  fiilolsA'ojiilols 
hIui  ri'ccivcd  a  T  iti  ihf  satiu-  area  i>n  iiuirt'  lliaii  mic  flight.  The  n-asxiis  for  those  T  grades  were  availahle  from  the 
<'otiiments  on  Vl  At!  ForiTi  21-1,  whir'h  aeeoiiipaiiied  Korin  2 1  -\.  Takeoff  «‘rrors  involved  pushing  the  throttles  up  too  high, 
which  can  overspeed  the  engines  and  the  gear.  The  prohlems  in  eireling  approaches  were  in  being  late  in  configuring 
the  aircraft,  f  or  \  f  K  patterns,  the  errors  involved  wide  and  long  or  steep  patterns.  On  w'et/sli|)perv  runway  procedures, 
several  pilots/copilots  flared  during  the  approach,  when  no  flare  is  desirable.  The  full-flap  landing  T  grades  arose  (rotn 
directional  control  problems  on  the  runway,  tihecklist  use  errors  anise  from  omissions  of  or  mistakes  in  checklists. 


Tabled.  Number  of  Pilola/Copilots  Rereivin|{  a T  Rating 
on  More  than  One  Flight  in  the  Areas  lasted 


Grading  Area  No.  of  Pilota/GopUots 

Takeoff  (RoUing/Statie)  I 

VFR  Approaches 

a.  Circling  Apiiroach  2 

b.  VFR  Pattern  .1 

Landings 

a.  Full-Flap  .1 

b.  W'et/Slippery  Runway  (R\X  )  Procedure  .1 

Checklist  Use  8 


These  areas  where  problems  were  more  persistent  <-an  lie  compared  to  another  set  of  errors  identified  by  1CF)VG. 
Two  ICEVG  IPs  were  asked  independently  to  judge  whether  the  errors  listed  in  comments  on  MAC  Form  21-1  were 
related  to  B-52  habits  or  not.  That  is,  which  errors  made  in  the  T-39A  appean-d  to  arise  from  habit  patterns  developed 
in  the  B-.52?  The  IPs  were  not  shown  the  T  grades.  The  <-onsensus  of  the  two  IPs  was  that  the  following  errors  were  B-,52 
related:  (a)  pushing  up  throttles  loo  high  on  takeoff  or  go-aroumis,  (b)  widi-  and  long  VFR  patterns,  (c)  slight  crab  or 
directional  control  problems  in  landing,  (dl  high  flare  and/or  early  |iower  reductions  during  the  approach,  (e)  flaring 
during  a  wet/slippery  runway  procedures  approach,  and  (fl  large,  abnipt  control  inputs.  These  problems  are  clearly 
related  to  the  areas  listed  in  Table  .1.  Ihe  only  items  in  the  table  which  are  not  in  the  ICEVG  list  are  checkli.sl  use 
and  circling  approach.  These  two  items  could  Isilh  be  attributed  to  general  lack  of  experience  in  the  T-39.  This 
inexperience  could  lead  to  “getting  Ik-IuiuI  the  aircraft"  or  overloading.  This  problem  was  most  apparent  during  the 
approach  and  landing  phase.  Where  sjas  ific  checklist  errors  were  ulenlified.  eight  (.3691)  of  them  oi'eurred  in  the 
approach  or  la-fore  landing  che<  klisls. 

These  data  suggest  that  habits  develoficd  in  the  B-.S2  i  arrv  over  when  dual  qualifying  in  the  T-.39.  These  habits 
can  be  pr-rsisteni  problems,  although  the  intensive  training  in  the  simulator  and  the  aircraft  did  allow  the  pilots/copilots 
to  overcome  them,  at  least  temporarily,  in  the  T-.39A  (i.e..  there  were  no  T  grades  on  the  fifth  (light  in  the  T-.39A|.  The 
next  step  is  to  examine  the  problems  of  concurrent  training  in  the  B-.A2  anri  T-.39B. 

The  eight  crews  varied  somewhat  in  tenns  of  the  niimla-r  of  flights  they  accomplished  in  the  T-39B.  Even  within 
a  crew,  there  were  variations  due  to  availability  of  the  crew  mi-mln-rs  for  T-,39B  activity.  Table  4  provides  a  summary 
of  the  number  of  flights  in  lheT-.39B  for<-ach  crew  memli«-r  from  the  eight  lest  r-rews. 
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Table  4.  Number  of  Sorties  in  the  T-39  for  each 
Crew  Member  in  the  Test  Crews 


Crew  iVo. 

PUol 

Copilot 

Radar  Navigator 

Navigator 

1 

10 

12 

9 

9 

2 

7 

5 

6 

4 

3 

9 

9 

8 

10 

4 

6 

4 

5 

5 

5 

8 

6 

2 

2 

6 

4 

7 

3 

,3 

7 

7 

4 

4 

4 

8 

8 

8 

6 

1 

For  each  of  the  flights,  data  on  pilotyropilot  performance  were  available  from  comments  in  the  flight  record  or  the 
4950  IP  evaluations.  Table  5  provides  a  siinuiiary  of  the  IP  evaluation  data  on  ratings  and  tolerance  deviations  in  the 
T-39B  for  pilots  and  copilots.  There  is  no  apparent  difference  between  pilots  and  copilots  in  the  ratings;  however,  the 
tolerance  deviations  do  reveal  a  small  difference.  The  more  experienced  pilots  appear  to  be  slightly  better  than  copilots 
at  handling  the  T-39. 


Table  5.  Proportions  of  T -39B  Ratings  of  each  Type  (E,  S,  M/U) 
and  Tolerance  Deviations  for  Pilot  and  CopUots 


Ralinga 

Tolerance  Deviations 

Subjects 

E 

s 

M/l’ 

<  1 

^1 

*2 

^3 

Pilots 

.03 

.93 

.04 

.41 

.49 

.08 

■■ 

Copilots 

.03 

.94 

.03 

..37 

.49 

.11 

■■ 

Of  greater  interest  is  the  pattern  of  tolerance  deviations  as  a  function  of  the  number  of  flights  in  the  T-39B.  This 
provides  an  insight  to  the  acquisition  of  skill  in  the  T-39B.  Table  6  presents  these  data  for  two  mission  portions,  takeoff/ 
climb/level-off  and  penetration/approach/landing.  Pilots  and  copilots  are  combined  since  they  both  show  the  same 
pattern.  The  data  are  also  divided  into  three  categories  of  experience  in  the  T-39B:  (a)  five  or  fewer  flights,  (b)  six  or 
seven  flights,  and  (c)  eight  or  more  flights.  Inspecting  the  changes  in  tolerance  deviations  as  a  function  of  experience 
level,  an  interesting  pattern  emerges.  Basically,  there  is  an  improvement  in  performance  on  the  takeoff/climb/level-off 
portion  of  the  mission,  but  no  such  improvement  occurs  for  penetration/approach/landing. '  Because  the  amount  of 
available  data  was  limited,  statistical  analyses  could  not  be  done  on  these  effects.  However,  the  pattern  is  reminiscent 
of  the  T-.39A  data  in  that  landing  reveals  a  slower  learning  progression.  Presumably,  with  a  greater  number  of  flights, 
the  penetration/approach/landing  portion  of  the  mission  would  also  show  improvement. 


Table  6.  Proportioiu  of  T-39B  Tolerance  Deviations  as  a  Function 
of  Number  of  Flights  in  the  T-39B  and  Flight  Segment 


No.  flights 

Takeoff7CUiiib/Level.Off 

Penet  ration/ Approach/Landing 

<  1 

^  1 

»2 

<  1 

I 

»2 

3^3 

5  or  less 

.12 

.73 

.13 

.03 

.55 

..37 

.07 

.01 

6/7 

.24 

.66 

.09 

.01 

.58 

..37 

.04 

.01 

8  or  more 

.43 

.55 

.02 

.00 

.55 

.40 

.04 

.01 

’The  large  proportion  of  <  1  deviations  in  the  penetration/approach/landing  segment  is  due  to  the  large  number  of  observations 
of  glide  slope  and  course  line  deviations  (up  to  12  for  each  approach). 
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Another  way  to  look  at  the  skill  acquisition  process  is  to  look  at  comments  made  by  the  IP.  Table  7  presents  a 
summary  of  such  comments  in  terms  of  the  number  of  pilots/copilots  receiving  a  negative  comment  as  a  function  of  the 
number  of  flights  on  the  T-39B  for  various  mission  segments.  The  comments  were  categorized  in  terms  of  the  area  of 
flight  to  which  they  applied  and  then  tabulated.  The  low  number  of  comments  on  bombing/visual  contour  reflects  to  some 
extent  the  limited  number  of  missions  on  which  it  was  accomplished.  Also,  the  lack  of  comments  on  the  takeoff/climb/ 
level-off/cruise  portion  in  the  early  flights  (No.  1  through  4)  may  be  partly  due  to  the  source.  Data  were  collected  from 
comments  on  the  flight  records  only  for  these  early  flights,  since  they  occurred  before  the  rating  forms  were  used. 
Nonetheless,  a  clear  general  pattern  emerges.  Penetration/approach/landing  persists  as  the  area  of  greatest  difficulty 
throughout  the  range  of  number  of  missions  accomplished  by  pilots/copilots  in  this  test. 


Table  7.  Number  of  Pilots/Copilots  Receiving;  a  Negative  Comment  Concerning 
Particular  Mission  Activities  as  a  Function  of  T*39B  Flight  Number 


T-.19B  Artiviliea 

T-39B  Flight  Numbrr 

1 

2 

3 

4 

s 

6 

7 

8 

9 

10 

II 

T  akeoff/Climb/Level-Off/Cruise 

PrtM'edure 

1 

4 

2 

2 

2 

Technique 

1 

1 

2 

5 

1 

2 

1 

Airspeed 

1 

3 

1 

Altitude 

1 

1 

1 

Heading 

1 

1 

Crew  CiMirdination  and  Communication 

Bombing/Visual  Contour 

Procedure 

1 

1 

Technique 

1 

1 

Airspeed 

1 

1 

1 

1 

Altitude 

2 

1 

Heading 

Crew  Coordination  and  Communication 

1 

Penetration/ Approach/Landing 

Procedure 

6 

1 

2 

7 

4 

4 

2 

1 

Technique 

2 

2 

3 

3 

2 

4 

1 

2 

Airspeed 

3 

2 

2 

3 

3 

1 

3 

1 

1 

1 

Altitude 

5 

2 

3 

1 

4 

3 

3 

1 

1 

1 

Heading 

5 

1 

5 

2 

4 

3 

3 

2 

2 

1 

Crew  C(M>rdination  and  Communication 

1 

1 

Go  Arounda 

Procedure 

1 

1 

1 

3 

1 

Technique 

4 

1 

3 

1 

1 

3 

General 

Control  Inputs 

8 

4 

3 

6 

5 

4 

4 

2 

2 

System  Operation 

2 

I 

3 

1 

2 

2 

2 

1 

Airspeed 

2 

1 

1 

As  in  the  T-39A  data,  of  interest  are  the  areas  which  show  persistent  problems  across  individuals.  In  considering 
those  errors  that  occurred  on  more  than  one  flight  for  a  particular  pilot/copilot  and  which  were  committed  by  more  than 
one  pilot/copilot,  three  problems  emerge.  First,  the  use  of  abnipt,  choppy  control  inputs  like  those  used  in  the  B-52. 
Second,  directional  control  problems  or  crab  in  landing  occur.  The  B-52  can  be  landed  in  a  crab  because  of  the  tumable 
trucks.  Third,  some  pilots/copilots  use  a  fast  rate  on  climb  out  after  takeoff.  Again,  the  B-52  requires  a  faster  rate  of 
climb  than  does  the  T-39.  It  appears,  then,  that  the  most  general  and  persistent  problems  are  those  which  are  related 
to  habits  developed  in  the  B-52. 
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A  final  factor  affecting  T-39B  performance  was  the  lime  between  flights.  Because  of  their  normal  <lulic>.  siimi'  crews 
had  delays  between  T-39B  flights  of  mon-  than  30  days.  This  would  !«•  a  critical  aspect  of  a  (]T.\  program.  Kemaining 
proficient  in  the  CTA  requires  that  the  crews  fly  at  regular  internals.  How  long  could  those  intervals  be'/  I'hc  data  in 
Table  8  provide  some  indication,  at  h-ast  for  pilots/copilots  at  the  level  of  skill  accpiired  in  this  test.  Table  8  presi-nts 
the  pattern  of  tolerance  deviations  as  a  function  of  number  of  days  since  the  last  flight  in  the  T-iWB.  The  data  arc  arranged 
in  three  categories:  (a)  0  days,  or  the  second  flight  on  a  parlii-iilar  day.  (b)  1  to  1 1-  days,  and  (c)  l.S  or  more  days.  The 
mean  scores  associated  with  these  three  categories  were  .3.3.S,  .'T.'Vl-.  and  .3.12.  respectivelv.  A  Vi  ilcoxon  test  on  the 
difference  between  1  to  14  days  and  15  or  more  days  was  significant  (]><  .05).  Basically,  there  is  an  increase  in  the 
proportion  of  tolerance  deviations  3=  1  or  greater  in  the  1.5  or  more  days  group.  That  is.  more  variabili;y  in  performance 
occurs. 


Table  8.  Proportions  of  T-39B  Tolerance  Deviations 
as  a  Function  of  Days  Since  Last  T -39  Fligtht 


Day* 

Tolerance  Deviations 

<  1 

5=  1 

3^2 

33 

0 

.43 

.50 

.06 

.01 

1-14 

.45 

.45 

.08 

.01 

15  or  more 

..32 

.52 

.11 

.05 

Interview  Data 

The  results  of  the  interviews  with  the  crews  can  be  most  easily  discussed  by  considering  the  responses  to  each  of 
the  eight  topics  separately. 

1.  Overall  impressions  of  the  program.  The  general  response  of  the  pilots  was  that  it  was  fun  to  fly  the  T-39B,  but 
that  the  radar  was  a  problem  for  the  crew.  Because  of  the  very  different  radar  unit,  crew  coordination  was  not  like  that 
which  occurs  in  the  B-52.  The  chance  to  practice  instrument  procedures  was  useful,  particularly  in  different  aerodromes. 
In  fact,  the  chance  to  practice  strange  field  procedures  and  other  diversification  aspects  of  the  program,  e.g. ,  new  routes, 
seemed  to  be  its  most  positive  contribution.  However,  due  to  scheduling  problems,  only  a  few  of  the  crews  were  able 
to  use  this  capacity  to  fly  to  different  fields  and  then  return.  Copilot  responses  mirrored  those  of  pilots.  They  felt  that 
T-39B  activity  was  good  for  proficiency  flying  and  for  diversification.  However,  differences  in  checklists  and  the  lack 
of  time  pressures  like  those  in  the  B-52  apparently  affected  crew  coordination  aspects  of  the  mission,  such  that  they 
were  not  like  the  primary  aircraft.  Pilots  and  copilots  both  felt  that  in  general,  the  cockpit  design  was  excellent. 

Radar  navigators  and  navigators  generally  had  a  ncgat'''e  response  to  the  lest.  Most  of  them  felt  that  the  navigation 
equipment  in  theT-39B  was  too  different  from  the  B-52  to  provide  any  training  and  was  in  fact  difficult  to  operate.  Because 
of  limited  radar  capabilities,  the  role  of  the  navigator  and  radar  navigator  were  reversed  in  the  T-,39B,  the  INS  providing 
primary  navigation  information  with  the  radar  as  a  backup  only.  Although  diversification  was  enjoyable,  both  the  radar 
navigator  and  navigator  had  little  to  do  in  the  T-39B  due  to  equipment  differences. 

2.  Changes  which  they  would  have  made  in  the  program.  Pilots  and  copilots  would  have  made  few  changes  to  the 
test  program.  Longer  range  for  the  test  aircraft  would  have  l>een  rlesirable.  Also,  they  staled  that  the  mission  scenario 
should  have  been  even  more  like  the  B-52  so  that  crew  coordination  would  have  been  more  of  a  requirement.  This  would 
have  basically  involved  using  a  different  radar,  which  was  the  main  point  made  by  radar  navigators  and  navigators.  They 
felt  that  a  better  radar  was  needed,  but  given  the  R-14C,  more  could  have  been  accomplished  if  the  resolution  had  simply 
been  better.  The  poor  resolution,  as  compared  to  the  B-52,  made  it  difficult  to  identify  and  track  offsets,  which  is  the 
primary  means  of  navigation  in  the  B-52. 

3.  What,  if  any,  training  occurred.  Both  pilots  and  copilots  fell  that  the  T-.39B  provided  useful  practice  in  iiistmnient 
procedures.  This  included  the  chance  for  aerodrome  diversification.  The  increased  air  time  may  also  have  iM-nefitted 
basic  airmanship.  Copilots  had  an  excellent  opportunity  to  practice  visual  navigation  and  mat)  interpretation  in 
coordination  with  the  navigators.  This  is  an  activity  for  which  they  receive  little  practice  in  the  B-,52  and  is  an  im|H)rtant 
backup  mode  of  operation. 


Radar  navigators  and  navigators  felt  that  they  received  little  training  in  the  T-39B.  The  hasie  problem  was  the 
limitations  of  the  R-14C.  Tadar  scope  interpretation  was  possible  for  experienced  individuals  such  as  the  radar 
navigators,  but  was  difficult  and  of  little  utility  for  navigators.  The  training  that  was  possible  in  basic  navigation  and 
target  direct  bombing  was  difficult  to  relate  to  (he  B-52  lu'eause  a  completely  different  way  of  thinking  was  involved. 

4.  Specific  problems  in  the  B-52  or  the  T-39.  No  specific  operational  problems  of  significance  were  identified  by 
any  of  the  crew  members.  One  radar  navigator,  after  flying  in  the  T-d9B,  mentioned  a  tendency  to  turn  the  map  to  match 
the  line-of-flight  in  the  B-52.  One  copilot  suggested  that  the  slower  pacing  in  the  T-39B  might  mislead  one  into  going 
too  slow  iii  the  B-52,  where  the  procedures  are  more  complex  and  much  more  numerous.  The  differences  between  the 
T-39  and  B-52  did  cause  some  discomfort.  Most  of  the  radar  navigators  and  navigators  suffered  at  least  one  case  of 
airsickness.  This  may  have  been  due  in  part  to  unsatisfactory  air  conditioning  in  the  rear  compartment  of  the  T-39. 
However,  the  difference  in  susceptibility  to  turbulence  is  clearly  an  issue  that  must  be  considered  in  the  use  of  a  CTA. 
It  may  be  necessary  to  limit  operations  to  only  mildly  turbulent  conditions,  as  was  done  in  this  test. 

5.  Probable  success  of  a  CTA  program,  given  better  equipment.  All  of  the  crew  members  felt  that  with  the  right 
equipment,  a  CTA  program  could  provide  excellent  training.  If  there  were  any  problems,  they  would  occur  for  very 
inexperienced  crew  members,  i.e. ,  new  copilots  and  navigators.  The  chance  for  diversification  would  even  provide  added 
incentive  in  training.  The  shorter,  more  task  intensive  training  flights  would  also  be  good. 

6.  Additional  equipment  which  would  be  necessary  in  a  CTA.  Over  and  above  the  equipment  in  the  T-39B,  pilots 
and  copilots  felt  that  the  CT  A  would  need  some  form  of  terrain  trace  so  that  terrain  avoidance  could  be  practiced.  Displays 
similar  to  those  on  the  B-52  system  might  even  be  useful  so  as  to  provide  practice  on  current  procedures.  Radar  navigators 
and  navigators  felt  that  an  offensive  system  like  that  on  the  B-52  is  necessary,  so  as  to  provide  effective  cross  training. 

7.  What  couldicould  not  be  training  in  a  CTA.  With  the  proper  equipment,  pilots  and  copilots  thought  that  instrument 
procedures,  low  level  flight,  and  crew  coordination  could  all  be  trained  on  a  CTA.  The  only  major  training  event  which 
everyone  agreed  could  not  be  trained  on  the  CTA  was  air  refueling.  Air  refueling  rendezvous  could  be  trained,  however. 
Radar  navigators  and  navigators  agreed  that  with  equipment  which  replicates  the  B-52,  all  of  their  training  events  could 
be  accomplished  in  a  CTA. 

8.  Scheduling,  for  the  test  program  and  for  a  CTA.  Scheduling  was  one  of  the  main  problems  for  the  concept  test. 
Since  B-52  flying  was  not  significantly  reduced,  T-,39B  flights  were  scheduled  whenever  time  was  available,  including 
mission  planning  days  for  the  B-52.  The  crews  felt  that  such  reductions  in  mission  planning  time  and  the  generally  heavy 
flying  schedule  were  detrimental.  The  original  scheme  to  cut  B-.52  flying  and  so  provide  entire  days  for  T-39B  flying 
would  have  been  better,  in  their  opinion.  As  far  as  a  CTA  program  is  concerned,  the  most  frequent  comment  was  that 
a  good  intermix  of  CTA  and  B-52  flyitig  would  be  needed.  One  would  need  to  fly  the  CTA  at  least  every  couple  of  weeks 
to  .stay  proficient  in  that  aircraft.  B-.52  flying  could  probably  be  reduced,  at  least  to  nine  sorties  a  quarter  if  not  less, 
and  the  CTA  could  be  flown  in  its  place. 

IV.  DISCUSSION 

Before  discussing  the  results  of  this  test,  it  would  be  appropriate  to  once  again  consider  the  limitations  which  affect 
their  utility  and  inteipretation.  The  cancellation  of  the  CTA  program  had  three  major  effects  on  the  test.  First,  it  limited 
data  collection  to  the  test  group  only.  The  lack  of  a  monitored  group  critically  affects  the  interpretation  of  the  B-52  data. 
The  results  that  were  found  could  simply  be  due  to  changes  normally  occurring  over  time  or  to  adaptation  to  the  test 
environment.  At  best,  the  data  could  reveal  whether  dual  qualification  had  any  immediate,  marked  negative  effects  on 
primary  aircraft  performance.  This  relates  directly  to  the  second  effect  of  program  cancellation,  i.e.,  the  short  duration 
of  the  test.  Since  the  crews  had  only  2  months  to  fly  integral  missions  in  the  T-39B,  the  data  could  only  reveal  short-term 
effects  on  performance.  The  long  term  effects  of  dual  qualification,  both  in  terms  of  primary  aircraft  performance  and 
secondary  aircraft  skill  acquisition,  could  not  be  determined.  Some  projections  concerning  the  latter  may  be  possible, 
but  they  must  be  stated  with  reservation.  The  third  effect  on  the  test  of  CT  A  cancellation  concerned  the  skill  maintenance 
issue.  Since  B-52  flying  time  was  not  reduced,  training  in  the  T-,39B  served  not  for  skill  maintenance,  but  rather  as 
added  practice.  It  did  not  substitute  for  B-.52  training.  If  there  were  positive  effects  on  performance,  they  may  have  come 
from  the  overall  increase  in  training  time  when  T-.39B  training  was  introduced.  Such  effects  may  indeed  inditate  that 


T-.'19B  training  stTved  us  an  »‘(f«‘clivr  sn[>|>l)‘tncnt  to  B-i>2  training.  Iml  tlwv  iln  not  allow  llic  ronciMsion  that  sin  li  Iraitiing 
could  compensate  for  reductions  in  B-.'r2  ui'tivity.  Also,  then-  is  *-ertaiid\  no  evideni  e  Ironi  the  lest  to  indicati'  the 
relationship  lietwreen  B-.S2  and  T-.'i9B  training,  i.e.,  how  imieh  T-.'f9B  training  wiinhl  e(|nal  a  certain  ainonnt  of  B-.>2 
training. 

Two  other  factors  which  affect  the  eonelnsions  concerning  a  possihle  (!T A  ninst  he  considered  h  irst,  the  test  had 
validity  for  pilots/i-opilots  only.  The  pilot/eopilot  station  a|>pproxinialed  what  eonhi  he  expected  in  a  ( !  T A  (piile 
accurately.  The  radar  navigator  and  navigator  stations  did  not.  The  B-l  K!  radar  was  selected  for  use  in  tin-  concept 
test  aircraft  due  to  cost,  sehi'dule,  and  availahililv  eonsidi'rations.  It  did  not  include  radar  features  and  eajiahilitii's  like 
the  B-.S2  or  those  planned  for  the  C  I  A.  This  severelv  limits  what  can  Iw  said  eoneerning  radar  nai  igator/na\  igator 
training.  The  second  point  to  note  is  that  the  test  was  not  jM-rformeil  in  tiu'  context  of  a  Vt  ST  program.  If  living  time 
were  reduced  by  use  of  the  WST,  it  is  not  clear  how  further  redm-tious  and  the  introdni’lion  of  a  (i'l'A  would  afleet  crew 
jrerformanee.  Such  an  issue  would  have  to  be  addressed  in  a  eomph-telv  separate  lest. 


Despite  this  litanv  of  limitations,  what  <an  the  results  ol  this  lest  tell  nsV  h  irst,  the  B-.')2  perlornianic  data  lor  pilots/ 
copilots  suggest  that  there  were  general  improvements  in  periormanee.  I  he  data  from  Bights  belore  I  -.T)  training  began 
suggest  that  this  was  not  simply  due  to  adapt  at  ion  to  the  lest  env  ironnient.  I'he  inlerv  iew  eonnneiils  support  the  heiielieial 
nature  of  T-.'19B  training  as  well.  Most  ol  the  pilots  .mil  copilots  felt  that  it  was  Inn  to  By  the  I'-. 19  anil  that  it  was  part  ieiilarlv 
beneficial  in  practicing  instrument/pallern  procedures.  The  eopilols  I  dt  that  the  training  was  also  use  fill  in  t)u*  ar<‘a  ol 
visual  navigation,  which  involves  crew  coordination  with  the  radar  nav  igator/nav  igator. 

Radar  navigator  and  navigator  data  were  too  limited  to  prov  ide  any  nselnl  inlormation.  Since  the  I  -.1911  nav  igation 
eipiipment  was  unlike  anvthing  in  the  B-.’>2  or  the  proposed  (.1  \.  such  inlormation  would  have  had  no  direct  hearing 
on  the  likelihoiMl  of  success  with  a  ("I'A  training  program  anvway.  I’asl  experieni  e  with  simulation  suggests  that  with 
a  high  fidelity  system  a  CT.A  could  be  an  efieelive  traiiiei.  Indeed,  the  general  leeling  ol  the  radar  navigators/iiav  igalors 
in  the  lest  group  was  that  with  the  right  e(|uipnient.  it  would  not  matter  which  ai  re  rail  they  were  By  ing. 

The  dual  qualification  data  from  the  T-ilB  for  pilots/eopilots  is  easier  to  interpret.  Both  the  ’V-:19A  and  T-;19B  data 
reveal  that  approach  and  landing  is  the  most  difficult  phase  of  T-.‘19  training  and  shows  the  slowest  progression  in  learning. 
In  fact,  over  the  range  of  number  of  Bights  in  the  T-.19B  experienced  in  this  lest,  no  significant  improvement  in 
performance  oi'Ciirred  in  the  approach  and  landing  pha.se.  This  compares  to  the  progression  in  aircraft  handling  in  the 
lakeoff/elimb/level-off  phase.  The  clear  implication  for  any  (iT.A  program  is  that  training  must  be  concentrated  on  the 
landing  pha.se.  It  is  the  phase  where  B-.S2  habits  are  most  inappropriate  and  could  be  dangerous.  .Although  no  safety 
of  Bight  problems  actually  iK'curred  in  this  li-st,  this  is  where  they  eonld  happen. 

The  data  on  the  effect  of  delays  between  Bights  in  the  T-.'19B  also  have  imfrlications  for  a  (!T,A  program.  Durini; 
initial  skill  acquisition  in  the  secondary  aircraft,  it  is  necessary  to  have  freipient,  regular  Bights.  In  this  test,  every  2 
weeks  seemed  to  be  a  rea.sonable  schedule.  l.onger  periods  of  lime  resulted  in  performance  decrements.  Kreqiieneies 
of  oni'e  a  week  or  once  every  2  weeks  would  appear  to  be  rea.sonable.  at  least  I'arlv  in  any  (JT.A  program. 

The  results  of  this  test  can  also  be  compared  to  those  from  Proji-el  (ionstant  lirowth  (Kantor.  Noble,  &  Reid,  l‘)77l 
and  the  Accelerated  Copilot  Knriehment  (.A(iK)  survey  (Ciekhoff,  19771.  In  Imlh  of  those  studies,  there  were  mixed  results 
of  secondary  aircraft  Bying  on  self-perceived  primary  aircraft  performanei-.  Both  beneficial  and  detrimental  effects  were 
found.  This  compares  to  the  pn-senl  results  where  neither  performanei-  data  nor  crew  reports  revealed  any  problems  in 
the  primary  aircraft.  The  other  two  studies  did  not  eoneeni  ihem.sidves  with  performance  in  the  secondary  aircraft.  The 
differences  in  the  results  may  arise  from  a  number  of  sources.  Kirst.  there  were  differences  in  the  secondary  aircraft 
used.  The  T-.'19.  according  to  the  pilots/eo[iilots  in  this  lest,  is  a  simple  aircraft  to  By.  The  ease  with  which  it  eonld  be 
learned  could  have  contributed  to  its  lack  of  effect  on  primary  aircraft  performance.  Second,  anil  perhaps  more 
importantly,  this  test  was  completed  over  a  much  shortiT  time  periml  than  the  other  two  studies.  This  meant  that  there 
was  less  lime  in  which  deeremenls  in  primary  aircraft  performam-e  could  develop  as  secondary  aircraft  skill  increased. 
Additionally,  the  low  level  of  sei'ondary  aircraft  skill  may  itself  have  contributed  to  the  laik  of  effects.  I  util  strong  habits 
were  develop«-d  in  that  aircraft,  they  would  be  unlikely  to  start  impinging  on  primary  aircraft  habits.  Third,  the  regime 
in  which  the  seeomlary  aircraft  was  Bown  may  be  im|>ortanl.  In  Constant  (Growth  and  ACK.  no  attempt  was  made  to  By 
primary  aircraft  ty|M‘  missions  in  the  secondary  aircraft.  The  latter  was  used  purely  for  general  fly  ing  skill  development. 


2.1 


In  this  test,  the  T-39B  missions  were  designed  to  be  as  similar  as  possible  to  B-52  missions.  Many  of  the  same  procedures 
were  practiced,  so  this  may  have  avoided  the  problem  of  using  different  procedures.  Finally,  and  this  relates  directly 
to  the  previous  point,  in  this  test  the  T-39B  instrument  panel  was  modified  to  reflect  B-52  instrumentation  as  much  as 
possible.  No  such  modification  occurred  in  the  other  two  studies.  Part  of  the  problems  encountered  in  those  studies  may 
have  arisen  from  conflicting  scan  patterns  or  trouble  in  using  different  instruments.  Returning  to  the  primary  aircraft 
may  have  required  some  readjustment.  This  could  have  led  to  slower  responding  by  the  operator  and  a  feeling  of  decreased 
performance.  Each  of  these  factors  may  have  contributed  to  the  differences  in  the  results.  Nonetheless,  all  three  studies 
reveal  some  benefit  of  secondary  aircraft  training  on  primary  aircraft  training  on  primary  aircraft  performance.  This 
obviously  bodes  well  for  a  possible  CTA  program. 

The  test  results  can  also  be  considered  in  the  light  of  transfer  of  training  predictions  for  pilots/copilots.  Basically, 
positive  transfer  was  expected  in  similar  stimulus  situations  where  responses  trained  in  one  aircraft  were  appropriate 
in  the  other,  negative  transfer  where  such  responses  were  inappropriate.  The  B-52  data  and  pilot/copilot  comments 
concerning  instrument  procedures  all  seem  to  indicate  positive  transfer  effects,  as  predicted.  Although  no  negative 
transfer  was  noticed  in  the  B-52,  there  was  some  in  the  T-39.  Both  in  T-39A  and  T-39B  training,  there  were  areas  where 
B-52  habits  affected  T-39  performance,  such  as  in  rough  aircraft  handling.  This  also  is  in  accordance  with  the  predictions. 
Although  the  evidence  is  meager,  the  expected  mixture  of  results  was  obtained.  Two  questions  arise  from  this.  First, 
as  skill  increases  in  the  secondary  aircraft,  would  more  or  less  negative  transfer  between  aircraft  occur?  Second,  even 
if  some  negative  transfer  occurred,  would  the  benefits  outweigh  the  problems  incurred?  This  test  does  not  provide  the 
answers  to  these  questions. 

One  of  the  positive  aspects  of  the  test  was  the  success  of  the  data  collection  procedures  developed  for  the  B-52 
and  T-39.  Although  there  was  some  problem  in  the  ratings  due  to  evaluator  differences,  in  general  the  measures  were 
effective.  They  were  sensitive  enough  to  detect  differences  which  were  predictable  (e.g.,  pilots  vs.  copilots),  as  well 
as  ones  which  were  not  (e.g.,  the  effect  of  days  between  flights  on  T-39B  performance).  This  suggests  they  could  be 
profitably  employed  in  other  contexts. 

Finally,  the  results  from  the  interviews  were  generally  supportive  of  the  CTA  concept.  With  adequate  offensive 
stations  and  a  terrain  trace,  most  crews  felt  that  a  CTA  could  provide  excellent  training.  None  of  the  pilots  or  copilots 
felt  that  flying  a  second  aircraft  hurt  their  B-52  performance.  The  problem  with  the  test  aircraft  basically  resided  in  the 
lack  of  a  good  radar.  Scheduling  was  a  problem  because  the  T-39  flying  was  simply  added  on  to  an  already  busy  B-52 
flying  schedule.  At  times  there  were  long  delays  between  T-39  flights.  In  a  CTA  program,  there  would  have  to  be  clear 
reductions  in  B-52  activity  and  regularly  scheduled  CTA  flights. 

In  summary,  the  results  of  the  test  were  affected  by  a  number  of  critical  factors.  This  meant  that  only  limited 
objectives  could  be  addressed.  The  clearest  results  concerned  the  process  of  dual  qualification  in  the  T-39.  The  number 
of  flights  accomplished  and  the  amount  of  time  between  flights  affected  pilot  and  copilot  pierformance  in  the  T-39.  The 
limited  data  available  on  the  impact  of  the  program  on  B-52  performance  revealed  no  negative  effects.  The  general 
reaction  of  the  crews  to  the  CTA  concept  was  positive.  Their  reaction  to  the  test  was  colored  by  inherent  limitations  in 
the  equipment  and  scheduling  difficulties. 
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APPENDIX  A:  ASSKSSMENTS 


Table  A-I .  Self  Assessnienlg  of  T-37Ar-38  Training  Impact  on 

Primary  Aircraft  Performance  (Project  Conatant  Growth) 

• 

Bcncftcisl 

No  Impact 

Detrimental 

N/A 

Performance  Area 

% 

«7r 

% 

% 

C-141  Copilots  (n  =  27) 

Instrument  flying 

44 

33 

22 

0 

Weapons  delivery 

0 

19 

7 

74 

Operating  procedures 

0 

37 

59 

4 

Formation  flying 

0 

14 

4 

82 

Aircraft  handling 

15 

33 

52 

0 

Crew  coordination 

15 

74 

11 

0 

Staying  ahead  of  L  nit  Equipment  ( L  El 

22 

48 

30 

0 

Overall  L’E  performance 

41 

18 

41 

0 

- 

F-1 1  ID  Pilots (n  =  23) 

Instrument  flying 

24 

60 

16 

0 

Weapons  delivery 

4 

72 

16 

8 

Operating  procedures 

8 

44 

48 

0 

Formation  flying 

56 

28 

16 

0 

-  , 's 

Aircraft  handling 

28 

36 

36 

0 

• 

Crew  coordination 

8 

50 

42 

0 

■ 

Staying  ahead  of  U  E 

24 

68 

8 

0 

Overall  UE  performance 

24 

52 

24 

0 

F-4E  Pilots  (n  =  14) 

Instrument  flying 

43 

50 

7 

0 

Weapons  delivery 

0 

83 

0 

17 

Operating  procedures 

0 

69 

31 

0 

Formation  flying 

38 

54 

8 

0 

Aircraft  handling 

0 

100 

0 

0 

Crew  coordination 

0 

69 

23 

8 

Staying  ahead  of  L E 

0 

92 

8 

0 

.  ^ , 

Overall  L  E  performance 

15 

69 

16 

0 

2 


Table  A  -2.  Assessments  by  Participating  Copilots  and  Their  Aire  raft 
Commanders  of  ACE  Program  Impact  on  Primary  Aircraft  Performance 


CoptloU _  Aircraft  Commanders 


Performance 

Beneftcial 

No  Impact 

% 

Detrimental 

% 

BenefteiaJ 

% 

No  Impact 

Detrimental 

'Tr 

Instrument  procedures 

91 

7 

3 

93 

6 

1 

Precision  approaches 

84 

14 

3 

85 

12 

4 

Non-precision  approaches 

84 

15 

2 

86 

13 

1 

Takeoff 

47 

51 

2 

48 

51 

1 

Landing 

45 

35 

21 

35 

34 

31 

Air  refueling 

28 

72 

1 

31 

69 

0 

Navigation 

76 

24 

1 

76 

25 

0 

Low  Level 

83 

18 

0 

43 

57 

0 

Communications 

78 

22 

0 

83 

16 

1 

Inflight  planning 

83 

18 

0 

82 

17 

1 

Cross  check 

89 

9 

2 

87 

9 

4 

Strange  field  procedures 

95 

5 

0 

86 

14 

1 

Crew  coordination 

58 

41 

1 

62 

32 

7 

Overall  performance 

93 

5 

3 

88 

8 

4 

Figure  B-l.  B-52  Pilot/copkiot  data  form. 


F igure  B-1,  B-52  IHlol/copilot  data  form  (CorUinuet 


Figure  B-I.  B-52  niol/copilot  data  form  (Continued) 


Figure  B-I .  B>52  Pilot/copUol  data  form  {Coruinuet 


Figure  B-2.  B-52  Radar  navif^ator/naviKator  data  form  (Contini 


Figure  C-  / .  T-39B  Pilot/copilol  data  form. 
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Figure  C-I.  T-39B  Paol/copaol  data  form  {Contirtued) 


F igure  C-l .  T -39B  PUol/copilot  data  form  (Continued) 


Figure  C-I.  T.39B  Pilol/copilot  data  form  (Continued) 


Figure  C-l.  T -39B  Pilot/copUot  data  form  {Concluded) 


APPENDIX  D:  CTA  ELECTRONIC  WARFARE  OfTICER  STATION  EVAI.LATION 


The  CTA  concept  of  operations  included  provisions  for  a  closed-loop  simulation  for  electronic  warfare  officer  ( EWO) 
training.  This  EWO  station  would  neither  receive  nor  transmit  signals  external  to  the  aircraft  due  to  the  weight  involved 
in  actual  reception/transmission  equipment.  The  system  would  present  a  variety  of  threat  indications  on  appropriate 
displays  and  provide  the  capability  for  a  full  range  of  EWO  responses.  Threat  presentations  might  even  be  Unlied  to 
the  aircraft  navigation  system  so  that  appropriate  effects  of  geographic  features  would  occur  (e.g.,  terrain  masking)  and 
threats  would  occur  during  appropriate  mission  segments  (e.g.,  target  penetration).  This  would  provide  a  basis  for 
increased  crew  coordination. 

When  the  concept  validation  test  of  the  CTA  was  originally  designed,  it  included  the  evaluation  of  an  EWO  station 
developed  by  the  Aeronautical  Systems  Division  (ASD/ENETV).  The  primary  purpose  of  this  station  was  to  demonstrate 
that  the  technology  was  available  to  construct  a  compact,  lightweight  trainer.  The  bulk  of  EWO  training  already  takes 
place  in  a  simulator,  the  AN/ALQ-T4,  and  the  possibility  of  effective  training  via  simulation  was  not  in  question.  Two 
issues  concerning  the  EWO  station  were  important,  however.  First,  could  a  system  be  built  that  would  satisfy  the  size 
and  weight  constraints  of  the  CTA?  Second,  what  equipment  would  need  to  be  simulated  and  at  what  level  of  fidelity 
in  order  to  provide  training? 

ASD/ENETV  consultations  with  representatives  of  HQ  SAC  and  ICEVG  produced  a  list  of  the  equipment  that  was 
most  critical  for  training.  Given  time  and  size/weight  constraints  for  the  T-39B,  the  systems  included  in  the  active 
simulation  were 

1 .  ALR-20A  Indicator  and  Control  Panel 

2.  ALR-46  Control  Indicator 

3.  ALQ-1 17  Monitor  and  Control  Indicator 

4.  ALE-24  Programmer  and  Selector  Control  Panels 

5.  ALE-20  Flare  Programming  Control  Panel 

6.  Master  Expendables  Control  Panel  (MEP) 

7.  Three  ALQ-155  Control  Indicator  Programmers  (CIPs) 

These  systems  were  capable  of  being  operated  by  the  EWO  and  provided  interactive  displays.  Other  systems  appeared 
as  dummy  panels  with  knobs  and  dials  but  were  not  active. 

Of  particular  interest  among  the  above  systems  were  the  three  ALQ-155  CIPs.  Although  the  ALQ-155  system  has 
been  installed  on  a  large  number  of  B-52G  and  H  aircraft,  the  AN/ALQ-T4  is  just  now  being  modified  to  reflect  these 
changes.  Given  the  limited  availability  of  training  time  on  the  ALQ-155  system  in  the  B-52,  the  EWO  station  could 
have  been  a  boon  for  procedural  training.  Unfortunately,  the  CTA  program  was  cancelled,  and  the  concept  test  was 
terminated  before  the  EWO  station  could  be  installed  and  tested  on  the  T-39B. 

Since  an  operational  test  of  the  EWO  station  was  not  possible,  an  alternative  method  of  evaluation  was  designed. 
This  involved  having  instructor  EWOs  from  ICEVG  operate  the  system  and  make  judgments  concerning  its  fidelity  and 
training  utility.  Such  judgments  would  provide  at  least  partial  answers  to  the  two  questions  mentioned  previously. 

METHOD 

Two  ICEVG  EWOs  travelled  to  ASD/ENETV  at  Wright-Patterson  AFB  to  test  the  EWO  station.  This  evaluation 
involved  rating  the  EWO  station  in  terms  of  two  areas:  (a)  fidelity  of  particular  systems  with  regard  to  B-52  systems  and 
(b)  the  training  capability  of  particular  systems.  The  ratings  were  done  on  a  seven  point  scale.  Table  D-1  presents  the 
verbal  descriptions  associated  with  each  of  the  ratings. 

The  ratings  were  done  during  several  missions  tun  on  the  EWO  station.  Each  piece  of  equipment  to  be  evaluated 
was  tested  in  various  modes  of  operation.  Each  system  was  rated  in  a  number  of  areas,  such  as  in  the  appearance  or 
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operation  of  controls.  Figure  D-1  presents  the  data  recording  form  used.  Each  of  the  systems  that  were  evaluated  is  listed, 
subdivided  into  particular  areas.  Each  evaluator  rated  each  item. 

RESULTS 

Since  the  inter-rater  reliabilities  for  both  fidelity  and  training  capability  were  extremely  high  (r  =  .89  and  r  = 
.93,  respectively),  the  ratings  from  the  two  evaluators  were  averaged  to  arrive  at  a  mean  rating  for  each  item.  The  mean 
ratings  are  represented  in  Figure  0-1  by  the  underlinings  on  each  scale.  For  example,  6  represents  a  mean  rating  of 

6,  while  6 _ 5  represents  a  mean  rating  of  5.5.  In  general,  the  ratings  were  fairly  high,  indicating  that  the  equipment 

closely  approximated  the  B-52  in  appearance  and  operation  and  could  have  provided  significant  training.  Where  the 
ratings  were  low,  comments  clearly  indicated  the  problem.  The  following  paragraphs  summarize  the  specific  comments 
concerning  each  system. 

ALR-20.  The  primary  problem  with  threat  and  jammer  appearance  was  that  they  were  too  perfect.  The 
representations  were  very  clear  and  symmetrical,  unlike  the  aircraft.  This  simplified  operations  on  them.  Also 
discontinuities  in  the  traces  prevented  the  audio  detent  function  from  working  properly  all  across  the  trace,  and  there 
was  no  audio  from  the  RF  test  signals. 

ALR-46.  The  symbols  were  smaller  than  those  on  the  B-52  ALR-46,  making  them  harder  to  discriminate.  Rather 
unrealistically,  they  all  moved  in  a  single  direction  and  at  the  same  speed.  The  audio  characteristics  of  the  threats  were 
not  completely  realistic.  The  rotation  function  for  the  diamond  worked  somewhat  differently  from  the  B-52. 

ALQ-117.  The  self-test  function  did  not  work  exactly  like  the  one  in  the  B-52.  The  displays  themselves  were  not 
quite  realistic. 

ALQ-155.  No  BIT  test  was  available.  There  was  also  some  jumpiness  in  the  frequency  control.  There  were  clear 
discontinuities  in  bandwidth  adjustments  as  well. 

ALE-24.  There  was  a  problem  with  a  delay  in  the  first  burst  when  the  system  was  activated.  There  also  were  no 
fault  lights. 

ALE-20.  One  notable  problem  was  that  the  system  did  not  reset  to  the  programmed  setting  after  being  operated. 
Also,  because  of  differences  in  the  types  of  controls,  it  was  not  possible  to  operate  the  system  in  a  realistic  fashion. 

MEP.  No  problems  were  noted. 

DISCUSSION 


The  general  evaluation  of  the  EWO  station  was  positive.  Both  in  terms  of  fidelity  and  training  capability,  the 
instructor  EWOs  felt  that  the  system  was  fairly  successful.  Many  of  the  small  differences  in  appearance  or  operation 
were  unimportant.  Most  of  the  problems  would  be  correctable,  depending  on  the  size/weight  constraints  of  the  aircraft. 
The  EW Os  felt  that  the  system  would  have  been  particularly  useful  as  a  procedures  trainer  for  the  ALQ- 1 55  system. 

How  do  these  results  relate  to  the  two  questions  mentioned  earlier?  First,  the  concept  of  a  light  weight 
microprocessor-based  EWO  training  system  was  successfully  validated.  The  system  would  have  been  able  to  provide 
some  training  even  though  it  (it  within  the  weight  and  size  constraints  of  the  T-39B.  In  terms  of  the  equipment  needed 
for  a  CTA,  both  instructor  EWOs  felt  that  more  of  the  systems  should  be  included  in  the  simulation,  such  as  the  ALQ-122, 
to  provide  more  complete  training.  Also,  a  wider  variety  and  greater  number  of  threat  signals  should  be  available.  On 
the  fidelity  issue,  the  only  major  problem  concerned  the  appearance  of  signals  on  the  ALR-20A.  Their  fidelity  may  be 
limited  by  the  means  by  which  they  are  produced.  However,  they  could  probably  be  degraded  somewhat  so  as  to  be 
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more  realistic.  A  minor  problem  arose  concerning  a  control  on  the  ALE-20.  In  general,  the  EWOs  stated  that  the  controls 
should  replicate  the  B-52  as  exactly  as  possible,  especially  where  this  affects  system  operations. 

In  summary,  the  EWO  station  met  the  requirements  of  the  concept  test.  It  provided  proof  that  a  microprocessor 
system  could  be  built  which  met  the  specifications  for  size  and  weight  and  still  provided  the  opportunity  for  training. 
Since  the  issue  in  this  test  was  primarily  one  of  demonstrating  technology,  the  problem  of  fidelity  was  not  critical.  Any 
future  systems  actually  employed  in  training  would  require  realistic  threat  and  jammer  displays.  Other  changes 
recommended  for  any  future  CTA  EWO  station  would  be  that  additional  equipment  be  simulated  and  minor  changes 
in  controls  be  made  to  provide  more  realism. 


SyMem 


Fidelity 


Training 

Capability 


ALR.20 

a.  Threat  appearance 

b.  Jammer  appearance 

c.  Expansion  trace  operation 

d.  Sweep  width  control 

e.  Audio  detent 

f.  RF  gain 

g.  Controls 

1.  Appearance 

2.  Operation 

ALR-46 

a.  Threat  indications 

b.  Audio  operations 

1.  Threat  characteristics 

2.  Diamond  audio 

c.  Handoff function 

1.  Unlatched  position 

2.  Rotation  of  diamond 

d.  Altitude  function 

e.  File  changes 

f.  Priority  function 

g.  Unknown  function 

h.  Search  function 

i.  Controls 

1.  Appearance 

2.  Operation 

ALQ-117 

a.  Threat  and  jammer  indications 

b.  Controls 

1.  Appearance 

2.  Operation 

c.  Displays 

d.  Correlation  with  ALR-46 


7  6  5  4  3  2  1  X 
7  6  5  4  3  2  IX 
7  6  5  4  3  2  1  X 
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7  6  5  4  3  2  IX 
7  6  5  4  3  2  1  X 


7  6  5  4  3  2  IX 

7  6_5  4  3  2  1  X 


7  6  5  4  3  2  IX 


7  6  5  4  3  2  1  X 

7  6  5  4  3  2  1  X 


7  6  5  4  3  2  1  X 

765  4_3  2  1  X 

7  6  5  4  3  2  1  X 
7_6  5  4  3  2  1  X 
7  6  5  4  3  2  1  X 

7  6  5  4  3  2  IX 

7  6  5  4  3  2  1  X 

7  6  5  4  3  2  IX 

7  6  5  4  3  2  1  X 


7  6  5  4  3  2  1  X 


7  6  5  4  3  2  IX 
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7  6  5  4  3  2  1  X 

7  6  5  4  3  2  IX 


7  6  5  4  3  2  1  X 
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7  6  5  4  3  2  IX 


7  6  5  4  3  2  IX 

7  6  5  _4  3  2  IX 

7  6  5  4  3  2  IX 


7  6  5  4  3  2  1  X 

7  6  5  4  3  2  1  X 

7  6  5  4  3  2  1  X 
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7  6  5  4  3  2  1  X 
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Figure  D-1.  E WO  aUtion  evaluation  data  form, 
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Fidelity 


Training 

Capability 


ALQ-ISS 

a.  Mode  selector 

b.  Frequency  control 

c.  BW  control 

d.  Indicator  light 

e.  Function  switches 

f.  Manual  mode 

1.  Operation 

2.  Error  indications 

g.  Semi-automatic  mode 

1.  Operation 

2.  Error  indications 

h.  Automatic  mode 

1.  Operation 

2.  Error  indications 

i.  Stack  indications 

j.  Modulation  selector 

ALE.24 

a.  SPD  operations 

b.  OOC  operations 

c.  Indicators 

d.  Controls 

!■  Appearance 
2.  Operation 

ALE.20 

a.  Dispensing  operations 

b.  Programming  operations 

c.  Indicators 

d.  Controls 

1.  Appearance 

2.  Operation 

MEP 

a.  Chaff  operation 

b.  Flare  operation 

c.  Controls 

1.  Appearance 

2.  Operation 
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Figure  D-1 .  EWO  station  evaluation  data  form  (Concluded) 
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